-- Logs begin at Sat 2022-01-29 02:50:47 UTC, end at Sat 2022-01-29 04:06:32 UTC. -- Jan 29 03:35:49.803657 dv-cinder-826949-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 29 03:35:49.812102 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 29 03:35:49 2022] *** Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: nodename: dv-cinder-826949-1-iscsi Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: machine: x86_64 Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: clock source: unix Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: pcre jit disabled Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: detected number of CPU cores: 4 Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: current working directory: / Jan 29 03:35:49.814651 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: detected binary path: /usr/bin/uwsgi-core Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: your processes number limit is 47680 Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: your memory page size is 4096 bytes Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: detected max file descriptor number: 2048 Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: lock engine: pthread robust mutexes Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: thunder lock: enabled Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 29 03:35:49.815345 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 29 03:35:49.858384 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: Python main interpreter initialized at 0x55a555b179c0 Jan 29 03:35:49.858384 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: python threads support enabled Jan 29 03:35:49.858384 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: your server socket listen backlog is limited to 100 connections Jan 29 03:35:49.858384 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: your mercy for graceful operations on workers is 90 seconds Jan 29 03:35:49.858700 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: mapped 403077 bytes (393 KB) for 2 cores Jan 29 03:35:49.858838 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: *** Operational MODE: preforking *** Jan 29 03:35:49.859038 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: *** uWSGI is running in multiple interpreter mode *** Jan 29 03:35:49.859038 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: spawned uWSGI master process (pid: 108807) Jan 29 03:35:49.859215 dv-cinder-826949-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 29 03:35:49.860791 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: spawned uWSGI worker 1 (pid: 108808, cores: 1) Jan 29 03:35:49.860791 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: spawned uWSGI worker 2 (pid: 108809, cores: 1) Jan 29 03:35:49.860791 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 29 03:35:51.648812 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:35:51.648812 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: from cryptography.utils import int_from_bytes Jan 29 03:35:51.649435 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:35:51.649435 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: from cryptography.utils import int_from_bytes Jan 29 03:35:51.671147 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:35:51.671147 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: from cryptography.utils import int_from_bytes Jan 29 03:35:51.671637 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:35:51.671637 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: from cryptography.utils import int_from_bytes Jan 29 03:35:54.252227 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 29 03:35:54.252760 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 29 03:35:54.253086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 29 03:35:54.253180 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 29 03:35:54.253263 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 29 03:35:54.253332 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 29 03:35:54.253424 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 29 03:35:54.253628 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 29 03:35:54.253723 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 29 03:35:54.253848 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 29 03:35:54.253939 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254235 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254361 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254563 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254657 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254887 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.254988 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255205 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255303 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255515 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255615 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255828 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.255926 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256144 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256230 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256462 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256553 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256719 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.256813 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257035 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257127 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257346 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257432 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826949-1-iscsi {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257665 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257760 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826949-1-iscsi {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.257973 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258057 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258299 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258386 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258610 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258703 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.258913 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259005 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259214 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259301 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259526 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259612 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.259831 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260014 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260333 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260554 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260671 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260785 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.260933 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261053 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261362 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261457 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261590 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261674 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261867 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.261953 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262197 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262346 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262519 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262613 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262828 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.262919 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263149 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263278 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263458 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263565 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826949-1-iscsi {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263861 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826949-1-iscsi {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.263955 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264176 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264290 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264486 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264795 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.264891 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.265188 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.265272 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.265497 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.265598 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.266354 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.266447 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.266678 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.266811 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267004 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267088 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267311 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267438 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267638 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267728 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.267954 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268038 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268273 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268368 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268572 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268666 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268880 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.268971 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269186 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269283 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269497 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269583 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269799 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.269888 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270103 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270263 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270377 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270470 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270664 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270749 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.270971 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271065 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271294 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271380 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271613 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271699 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271865 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.271952 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272114 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272201 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272414 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272509 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272735 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.272821 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273039 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273130 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273352 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273446 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273655 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273745 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.273958 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274042 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274285 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274375 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274592 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274701 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274893 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.274977 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275195 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275287 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275497 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275813 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.275898 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276126 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276218 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276431 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276515 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276740 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.276824 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277060 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277146 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277374 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277465 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277682 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277768 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.277994 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278079 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278352 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278440 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278665 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278759 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.278971 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279055 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279292 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279385 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279600 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279700 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279904 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.279990 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280208 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280301 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280511 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280608 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280831 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.280924 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.281140 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.281224 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.281459 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282076 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282286 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282374 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282591 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282677 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.282898 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283001 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283211 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283305 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283514 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283600 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283818 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.283909 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284120 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284213 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284418 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284502 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284722 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.284807 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285027 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285111 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285332 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285415 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285636 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285721 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.285935 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.286025 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.286257 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.286345 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.286562 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.286648 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287116 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287207 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287422 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287588 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287741 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.287827 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288045 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288129 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288350 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288443 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288653 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288737 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.288956 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289047 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289257 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289351 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289567 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289671 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289868 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.289960 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290200 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290352 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290501 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290591 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290805 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.290899 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291105 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291200 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291415 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291502 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291720 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.291804 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292026 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292121 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292324 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292410 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292629 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292715 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.292931 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293030 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293244 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293329 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293549 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293641 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293846 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.293942 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294164 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294264 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294470 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294562 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294775 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.294871 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295072 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295167 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295368 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295452 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295663 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295755 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.295959 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296044 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296275 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296366 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296676 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.296888 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297025 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297220 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297319 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297526 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297614 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297845 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:35:54.297932 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298193 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298294 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298538 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298651 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298854 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.298939 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299183 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299277 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299515 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299667 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299834 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.299966 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300145 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300285 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300455 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300584 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300768 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.300905 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301076 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301213 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301385 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301515 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301690 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301830 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.301998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302190 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302337 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302424 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302651 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302759 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.302970 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303064 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303283 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303368 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303597 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303681 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303907 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.303995 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304212 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304304 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304530 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304616 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304860 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.304993 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305174 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305282 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305462 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305548 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305800 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.305887 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306114 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306229 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306458 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306556 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306767 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.306879 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307079 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307165 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307387 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307483 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.307780 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308002 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308094 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308308 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308476 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308622 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308708 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.308929 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309015 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309244 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309367 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309581 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309666 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309878 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.309986 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310205 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310298 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310511 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310595 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310812 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.310895 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311112 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311199 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311413 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311506 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311714 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.311807 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312033 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312120 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312336 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312420 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312683 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.312810 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313015 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313110 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313324 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313417 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313635 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313729 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.313944 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314031 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314282 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314372 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314591 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314690 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.314902 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315001 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315230 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315370 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315514 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315610 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315827 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.315921 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316128 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316213 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316431 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316528 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316741 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.316827 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317043 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317127 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317348 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317434 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317654 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317740 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.317960 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318050 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318291 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318389 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318599 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318684 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318913 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.318997 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319222 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319359 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319532 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319619 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319868 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.319965 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320171 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320259 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320483 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320569 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320804 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.320903 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321120 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321206 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321423 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321509 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321724 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.321817 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322023 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322108 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322352 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322439 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322656 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322760 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.322960 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323045 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323262 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323347 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323565 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323668 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323857 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.323944 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324155 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324241 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324456 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324542 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324755 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.324841 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325072 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325156 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325374 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325462 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325673 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325758 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.325970 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326054 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326291 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326389 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326627 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326720 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.326930 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327022 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327274 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327386 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327586 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327673 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.327908 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.328007 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.328741 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.328902 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329054 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329138 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329367 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329522 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329661 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329802 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.329961 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330045 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330285 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330390 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330605 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330697 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330901 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.330986 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331207 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331301 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331516 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331610 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331822 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.331909 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332138 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332235 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332444 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332530 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332764 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.332851 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333061 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333158 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333374 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333468 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333712 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.333798 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334039 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334152 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334376 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334463 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334686 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334772 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.334994 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335088 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335301 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335387 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335605 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335693 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335910 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.335996 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336215 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336306 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336522 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336617 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336827 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.336914 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.337141 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.337227 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.337450 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.337672 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.337761 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338022 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338107 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338398 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338484 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338702 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.338790 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339014 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339111 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339340 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339521 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339672 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339840 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.339981 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.340250 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.340384 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.340587 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.340727 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.340894 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341022 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341206 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341343 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341530 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341662 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341844 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.341979 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342162 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342296 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342476 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342613 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342778 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.342912 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343084 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343212 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343393 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343523 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343695 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.343823 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.344595 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.344729 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.344907 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345055 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345214 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345355 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345516 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345682 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345821 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.345966 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346121 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346272 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346445 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346589 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346757 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.346888 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347079 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347209 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347381 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347522 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347688 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.347818 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348006 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348139 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348310 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348452 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348613 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348746 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.348917 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349063 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349206 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349346 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349516 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349645 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349819 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.349949 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350105 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350332 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350466 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350599 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350753 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.350896 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351051 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351183 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351359 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351492 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351667 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351802 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.351974 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352115 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352287 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352423 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352596 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352734 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.352905 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353041 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353232 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353367 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353542 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353684 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353848 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.353989 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354216 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354350 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354544 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354693 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354854 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.354995 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.355163 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.355294 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.355480 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.355691 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.355830 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356074 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356205 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356384 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356520 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356691 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.356956 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.357187 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.357337 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.357503 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.357641 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.357888 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.358016 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.358229 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.358483 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.358623 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.358864 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359005 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359189 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359331 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359538 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359671 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.359848 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360066 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360199 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360390 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360480 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360724 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.360822 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361029 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361113 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361333 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361420 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361636 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361724 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.361940 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362026 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362277 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362401 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362589 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362711 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.362902 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363045 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363210 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363349 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363518 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363653 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363831 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.363976 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364143 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364282 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364450 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364594 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364802 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.364896 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365109 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365203 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365418 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365512 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365736 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.365863 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366043 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366148 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366379 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366465 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366684 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.366773 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367009 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367094 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367321 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367415 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367625 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367711 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.367930 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368022 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368232 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368327 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368552 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368645 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368868 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.368961 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369169 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369263 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369472 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369559 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369773 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.369903 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370080 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370240 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370441 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370578 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370742 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.370873 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371049 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371187 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371351 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371480 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371655 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371793 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.371956 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372086 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372256 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372387 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372553 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372681 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372851 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.372980 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373155 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373292 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373457 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373596 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373764 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.373902 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374063 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374219 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374394 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374533 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374695 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374823 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.374993 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375142 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375323 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375471 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375608 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375743 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.375916 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376047 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376214 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376355 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376516 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376652 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376816 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.376952 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377119 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377256 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377419 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377548 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377717 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.377846 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378024 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378191 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378341 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378437 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378641 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378727 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.378939 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379026 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379243 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379388 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379542 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379638 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379862 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.379945 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380169 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380260 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380470 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380558 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380773 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.380862 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381078 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381165 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381379 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381473 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381677 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381763 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.381976 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382069 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382302 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382411 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382608 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.382907 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383007 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383207 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383313 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383507 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383594 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383812 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.383898 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384110 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384204 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384413 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384506 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384714 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.384800 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385010 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385102 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385308 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385400 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385604 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385903 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.385989 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386248 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386351 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386561 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386669 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386864 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.386973 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387168 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387285 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387472 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387600 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387814 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.387901 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388116 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388202 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388474 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388570 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388783 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.388870 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389095 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389179 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389403 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389497 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389711 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.389804 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.390014 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.390158 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.390349 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.390511 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.390658 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.391270 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.391688 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.391774 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.391774 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.391938 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392071 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392155 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392375 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392462 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392677 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392776 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.392998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393305 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393389 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393610 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393698 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.393913 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394004 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394248 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394340 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394559 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394654 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394868 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.394953 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395175 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395392 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395484 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395565 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395776 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.395864 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396083 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396214 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396383 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396467 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396677 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396765 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.396984 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397077 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397285 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397380 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397594 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397678 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397902 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.397996 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398226 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398323 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398536 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398623 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398841 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.398983 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399146 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399229 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399449 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399534 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399770 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.399863 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400076 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400207 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400386 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400488 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400691 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.400781 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401000 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401304 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401391 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401651 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401744 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.401966 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402051 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402294 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402385 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402647 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402746 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.402957 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403053 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403269 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403355 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403589 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403677 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403890 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.403974 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404196 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404288 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404504 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404617 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404828 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.404965 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405135 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405229 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405440 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405539 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405744 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.405835 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.406065 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.406183 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.406951 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407049 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407275 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407361 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407577 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407833 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.407929 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408010 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408172 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408289 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408496 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408685 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408798 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.408998 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409119 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409307 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409537 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409626 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409850 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.409949 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410170 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410299 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410567 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410689 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410882 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.410972 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.411189 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.411283 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.411509 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.411595 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412083 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412176 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412393 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412499 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412700 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.412786 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413003 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413089 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413314 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413407 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413636 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413721 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.413953 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414039 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414285 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414387 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414600 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414710 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.414908 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415039 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415233 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415391 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415559 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415735 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415876 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.415965 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416197 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416285 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416554 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416650 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416865 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.416952 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417170 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417257 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417474 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417569 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417797 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.417884 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418103 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418221 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418507 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418596 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418817 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.418909 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419122 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419209 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419425 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419511 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419730 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.419818 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420036 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420126 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420343 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420443 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420647 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420733 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.420954 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421048 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421258 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421346 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421563 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421663 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421871 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.421983 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422225 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422316 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422552 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422648 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422852 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.422946 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423157 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423244 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423460 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423554 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423779 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.423873 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424093 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424186 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424399 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424491 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424705 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.424793 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425009 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425102 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425312 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425399 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425654 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425742 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.425959 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426046 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426302 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426390 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426620 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426710 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.426942 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427035 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427247 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427341 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427551 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427638 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427861 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.427948 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428163 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428321 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428466 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428553 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428770 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.428867 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429075 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429182 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429375 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429472 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429677 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429764 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.429975 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430071 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430301 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430391 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430608 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430697 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.430915 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431044 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431218 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431305 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431516 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431613 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431812 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.431900 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432110 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432196 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432425 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432512 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432738 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.432834 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433051 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433144 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433354 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433454 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433658 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433746 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.433957 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434044 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434315 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434404 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434620 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434708 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.434941 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435030 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435255 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435350 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435568 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435655 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435879 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.435966 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436189 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436283 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436498 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436622 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436810 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.436897 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437118 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437214 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437431 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437517 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437772 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.437861 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438087 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438217 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438424 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438629 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438742 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.438960 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439064 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439276 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439370 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439589 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439676 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439903 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.439998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.440218 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.440453 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.440540 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.440781 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.440878 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441095 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441187 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441407 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441493 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441718 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.441814 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442031 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442118 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442371 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442460 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442682 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442782 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.442992 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443302 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443402 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443613 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443713 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.443927 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444014 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444245 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444335 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444567 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444654 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444900 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.444987 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445205 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445303 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445515 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445602 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445826 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.445923 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446182 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446303 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446467 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446553 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446775 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.446872 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447189 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447397 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447484 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447705 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.447793 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448012 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448107 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448318 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448411 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448624 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448720 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.448931 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449018 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449243 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449330 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449555 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449644 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449862 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.449948 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.450194 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.450296 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.450505 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.450593 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.450831 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451015 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451149 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451329 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451468 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451661 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451782 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.451985 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.452099 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.452310 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.452416 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.452625 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.452927 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.453014 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.453758 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.453856 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454063 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454205 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454397 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454487 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454709 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.454796 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455018 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455113 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455321 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455408 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455640 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455735 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.455951 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456038 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456252 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456337 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456561 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456654 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456868 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.456964 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.457168 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.457395 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.457482 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.457738 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.457834 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458054 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458168 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458403 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458490 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458713 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.458808 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459029 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459242 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459330 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459588 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459688 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459905 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.459993 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460229 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460314 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460542 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460638 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460850 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.460946 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461154 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461241 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461455 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461553 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461764 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.461858 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462068 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462183 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462395 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462492 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462704 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.462792 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463006 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463095 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463307 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463403 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463618 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463706 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.463917 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464002 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464218 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464310 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464524 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464610 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464825 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.464919 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465124 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465218 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465429 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465516 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465729 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.465827 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466028 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466114 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466353 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466440 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466655 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466752 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.466955 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467043 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467256 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467343 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467560 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467656 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467871 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.467965 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.468174 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.468262 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.468482 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.468577 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.468786 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.469418 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.469635 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.469872 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.469959 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.470304 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.470396 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.470631 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.470869 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471004 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471239 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471335 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471586 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471801 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.471899 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.472119 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.472433 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.472559 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.472756 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.472843 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473075 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473162 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473404 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473491 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473718 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.473804 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474026 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474120 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474361 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474451 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474664 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474752 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.474986 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475279 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475368 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475589 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475675 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475896 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.475983 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476202 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476290 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476509 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476595 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476817 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.476905 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477126 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477222 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477432 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477519 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477738 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.477833 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478045 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478169 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478377 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478507 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478686 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478783 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.478998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479086 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479309 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479397 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479620 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479718 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.479927 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480015 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480237 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480323 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480542 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480629 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480848 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.480935 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481156 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481245 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481463 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481597 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481774 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.481862 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482100 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482260 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482437 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482526 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482742 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.482830 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483056 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483170 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483369 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483458 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483679 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483773 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.483991 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484091 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484301 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484389 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484642 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484729 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.484976 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485077 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485292 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485379 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485599 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485686 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.485905 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486020 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486265 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486368 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486608 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.486938 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487032 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487265 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487356 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487572 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487659 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487876 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.487980 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488180 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488267 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488486 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488581 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488793 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.488879 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489126 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489221 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489437 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489532 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489759 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.489847 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490068 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490211 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490415 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490515 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490719 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.490806 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491030 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491153 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491341 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491441 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491651 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491740 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.491958 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492046 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492288 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492384 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492596 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492905 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.492991 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493212 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493299 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493521 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493608 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493829 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.493915 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494166 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494260 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494476 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494562 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494787 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.494884 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495089 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495176 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495413 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495512 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495725 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.495821 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496038 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496126 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496350 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496447 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496656 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496750 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.496962 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497058 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497280 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497366 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497595 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497698 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497899 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.497993 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498243 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498331 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498560 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498647 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498871 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.498957 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499184 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499273 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499494 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499819 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.499904 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500150 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500239 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500466 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500555 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500776 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.500863 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501091 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501186 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501407 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501510 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501721 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.501816 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.502048 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.502199 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.502376 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.502463 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.502619 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 29 03:35:54.502707 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.503027 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.503375 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.503689 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.504034 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.504365 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.504681 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.504994 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.505302 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:35:54.505548 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 29 03:35:54.526404 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.527980 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_db.sqlalchemy.engines [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.589325 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.context [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56d64fc2-fc63-462e-9bec-aa175bb73d4b(cell1) {{(pid=108809) load_cells /opt/stack/nova/nova/context.py:464}} Jan 29 03:35:54.589544 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.context [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56d64fc2-fc63-462e-9bec-aa175bb73d4b(cell1) {{(pid=108808) load_cells /opt/stack/nova/nova/context.py:464}} Jan 29 03:35:54.593477 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_concurrency.lockutils [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:35:54.593590 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:35:54.595696 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_concurrency.lockutils [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:35:54.595816 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:35:54.596506 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_concurrency.lockutils [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:35:54.596597 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:35:54.598448 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:35:54.598562 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_concurrency.lockutils [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:35:54.608448 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_db.sqlalchemy.engines [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.610365 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.612510 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.614918 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_db.sqlalchemy.engines [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.772170 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG oslo_db.sqlalchemy.engines [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:54.774791 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:35:55.170244 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: WARNING keystonemiddleware.auth_token [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:35:55.176873 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: WARNING keystonemiddleware.auth_token [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:35:55.194760 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: WARNING keystonemiddleware.auth_token [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:35:55.201165 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: WARNING keystonemiddleware.auth_token [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:35:55.515988 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: WARNING keystonemiddleware.auth_token [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:35:55.521194 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: WARNING keystonemiddleware.auth_token [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:35:55.526491 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a555b179c0 pid: 108809 (default app) Jan 29 03:35:55.528543 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:35:55.529701 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jan 29 03:35:55.530146 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sat Jan 29 03:35:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:35:55.546593 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: WARNING keystonemiddleware.auth_token [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:35:55.552302 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: WARNING keystonemiddleware.auth_token [None req-3c2b2e80-30df-4ed6-9ff3-9d2379ce8afd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:35:55.557545 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a555b179c0 pid: 108808 (default app) Jan 29 03:37:22.839998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:22.840998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jan 29 03:37:22.841385 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:23.261106 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b283b860-11bd-49ab-b09e-a9dbe79aad0a admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:23.290732 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b283b860-11bd-49ab-b09e-a9dbe79aad0a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442466 Jan 29 03:37:23.294192 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Jan 29 03:37:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:37:25.563682 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:25.564725 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-2da26d20-cf05-443f-9a73-bb6cb2f41b2e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 29 03:37:25.565078 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:25.637939 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-e27aa9d0-72a7-4e4f-b581-533d239216f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:25.656698 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:37:25.656698 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:37:25.758936 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-e27aa9d0-72a7-4e4f-b581-533d239216f9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.187803 Jan 29 03:37:25.759659 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:25.979049 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-f0423415-bfd2-4ed7-94ef-1acd63ede155 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:25.981475 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:37:25.981475 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: warnings.warn(msg) Jan 29 03:37:26.079214 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-f0423415-bfd2-4ed7-94ef-1acd63ede155 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311107 Jan 29 03:37:26.079930 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Jan 29 03:37:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:28.351053 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-e27aa9d0-72a7-4e4f-b581-533d239216f9 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:28.352131 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-e27aa9d0-72a7-4e4f-b581-533d239216f9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jan 29 03:37:28.352547 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:28.461481 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-5af52cfa-9a01-4802-99cf-c0d45119188b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:28.483850 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:37:28.483850 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: warnings.warn(msg) Jan 29 03:37:28.602075 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-5af52cfa-9a01-4802-99cf-c0d45119188b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.243086 Jan 29 03:37:28.602075 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:28.616519 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-bc38dd8a-ac3e-4201-b3b9-d4aa7c7b9ec0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:28.618057 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:37:28.618057 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:37:28.773983 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-bc38dd8a-ac3e-4201-b3b9-d4aa7c7b9ec0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160879 Jan 29 03:37:28.774817 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Jan 29 03:37:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:31.033985 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-5af52cfa-9a01-4802-99cf-c0d45119188b admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:31.035471 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-5af52cfa-9a01-4802-99cf-c0d45119188b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001914 Jan 29 03:37:31.036255 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:31.094621 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-17023c33-af02-44b8-9e5b-061a11d6ebbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:31.169400 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-17023c33-af02-44b8-9e5b-061a11d6ebbf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127157 Jan 29 03:37:31.170279 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:31.181739 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-89efc817-f76c-494e-9bd1-952da86c03c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:31.281965 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-89efc817-f76c-494e-9bd1-952da86c03c4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103847 Jan 29 03:37:31.282597 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Jan 29 03:37:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:37:33.570094 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-17023c33-af02-44b8-9e5b-061a11d6ebbf admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:33.571162 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-17023c33-af02-44b8-9e5b-061a11d6ebbf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jan 29 03:37:33.571564 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:33.628258 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-826d7bd9-e790-4c21-bc09-2053af8cf883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:33.686051 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-826d7bd9-e790-4c21-bc09-2053af8cf883 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.108101 Jan 29 03:37:33.686633 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:33.698398 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-ae8f5e72-9193-4f4a-9bcd-e0a09880778e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:33.757325 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-ae8f5e72-9193-4f4a-9bcd-e0a09880778e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062551 Jan 29 03:37:33.758111 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Jan 29 03:37:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:37:36.025943 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-826d7bd9-e790-4c21-bc09-2053af8cf883 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:36.026978 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-826d7bd9-e790-4c21-bc09-2053af8cf883 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 29 03:37:36.028118 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:36.086693 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:36.170706 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136400 Jan 29 03:37:36.171257 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:36.183021 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-d1c8c430-e853-49ec-8529-664e48297d36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:36.266210 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-d1c8c430-e853-49ec-8529-664e48297d36 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086408 Jan 29 03:37:36.267027 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Jan 29 03:37:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:38.541927 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:38.544076 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002522 Jan 29 03:37:38.544645 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:38.632222 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-9f0a2b7c-173f-410c-ab48-b1f6b409d52c admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:38.655456 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-9f0a2b7c-173f-410c-ab48-b1f6b409d52c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.104582 Jan 29 03:37:38.664866 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Jan 29 03:37:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:37:41.698837 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:41.699805 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-46dacb2d-bd01-420c-b12b-eae1df22d091 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jan 29 03:37:41.703236 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:41.760544 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-dbdf8658-e0e4-449b-bdfa-8342d2e4b76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:41.841001 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-dbdf8658-e0e4-449b-bdfa-8342d2e4b76b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.132798 Jan 29 03:37:41.841550 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:41.853193 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-35dc2ae2-cfdd-466c-b379-83b152b8ac9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:41.941313 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-35dc2ae2-cfdd-466c-b379-83b152b8ac9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091662 Jan 29 03:37:41.941805 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Jan 29 03:37:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:44.318327 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-dbdf8658-e0e4-449b-bdfa-8342d2e4b76b admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:44.319342 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-dbdf8658-e0e4-449b-bdfa-8342d2e4b76b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jan 29 03:37:44.319752 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:44.409768 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-abd38df3-16b4-4fdc-b49e-3ee174da3e6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "id": "2", "swap": 0}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:44.495269 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-abd38df3-16b4-4fdc-b49e-3ee174da3e6b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162892 Jan 29 03:37:44.495778 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 29 03:37:44.510882 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-9d249796-9d64-4691-abf5-85339ff2510b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:44.584535 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-9d249796-9d64-4691-abf5-85339ff2510b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080521 Jan 29 03:37:44.585165 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Jan 29 03:37:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:46.834786 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-abd38df3-16b4-4fdc-b49e-3ee174da3e6b admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:46.835795 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-abd38df3-16b4-4fdc-b49e-3ee174da3e6b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 29 03:37:46.836534 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:46.893193 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-1c67982d-5593-451e-b013-4c4dd09f41a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:46.983645 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-1c67982d-5593-451e-b013-4c4dd09f41a1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140744 Jan 29 03:37:46.995601 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:46.995975 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-ace300ed-a330-44c9-812b-cb2ccc81f5a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:47.075834 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-ace300ed-a330-44c9-812b-cb2ccc81f5a4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083408 Jan 29 03:37:47.076425 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Jan 29 03:37:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:49.324644 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-1c67982d-5593-451e-b013-4c4dd09f41a1 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:49.325659 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-1c67982d-5593-451e-b013-4c4dd09f41a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jan 29 03:37:49.326317 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:49.403986 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-5a7777b6-311a-4ca0-bae9-223f143d3c44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:50.071745 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-5a7777b6-311a-4ca0-bae9-223f143d3c44 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.739547 Jan 29 03:37:50.072307 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:37:50.084545 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-81e3cdfd-4068-40f9-b054-c01c7b040599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:50.164016 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-81e3cdfd-4068-40f9-b054-c01c7b040599 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083045 Jan 29 03:37:50.164641 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Jan 29 03:37:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:37:52.440256 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-5a7777b6-311a-4ca0-bae9-223f143d3c44 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:37:52.442018 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-5a7777b6-311a-4ca0-bae9-223f143d3c44 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Jan 29 03:37:52.447294 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:37:52.505783 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:52.586360 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137714 Jan 29 03:37:52.586922 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Jan 29 03:37:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 29 03:37:52.599600 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-59b40bf2-0ff6-45a9-abcb-e32d2b4b42f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:37:52.738616 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-59b40bf2-0ff6-45a9-abcb-e32d2b4b42f7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142928 Jan 29 03:37:52.739212 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Jan 29 03:37:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:38:14.809116 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:14.810116 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 29 03:38:14.810544 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:14.866907 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-96cbb028-06b6-4d4f-8064-8afb0bcbb97c admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:14.884053 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-96cbb028-06b6-4d4f-8064-8afb0bcbb97c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067546 Jan 29 03:38:14.884591 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Jan 29 03:38:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:16.250059 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:16.251132 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-8f71ea15-964f-44af-9a1e-4b64a4f6c1cf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 29 03:38:16.251535 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:16.440932 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-e23e2454-346e-468a-af3e-fec84ad2eb37 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:16.446339 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.wsgi [None req-e23e2454-346e-468a-af3e-fec84ad2eb37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 29 03:38:16.446899 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-e23e2454-346e-468a-af3e-fec84ad2eb37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:16.447684 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-e23e2454-346e-468a-af3e-fec84ad2eb37 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057333 Jan 29 03:38:16.448219 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Jan 29 03:38:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 29 03:38:16.457496 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-6b01875c-1250-4a5c-b428-826d4417fb15 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:16.478153 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-6b01875c-1250-4a5c-b428-826d4417fb15 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024131 Jan 29 03:38:16.478626 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:16.488265 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-87183a8a-3378-484c-a022-07b718d85176 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:16.508736 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-87183a8a-3378-484c-a022-07b718d85176 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023839 Jan 29 03:38:16.509259 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:38:16.518206 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-a4387ed8-67f8-4783-9293-2df9b315666e admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:16.523435 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.wsgi [None req-a4387ed8-67f8-4783-9293-2df9b315666e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 29 03:38:16.523996 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-a4387ed8-67f8-4783-9293-2df9b315666e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:16.524781 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-a4387ed8-67f8-4783-9293-2df9b315666e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010036 Jan 29 03:38:16.525271 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Jan 29 03:38:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 29 03:38:17.792281 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-87183a8a-3378-484c-a022-07b718d85176 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:17.793310 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-87183a8a-3378-484c-a022-07b718d85176 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 29 03:38:17.793710 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:17.995110 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-506a14df-b838-442a-980b-9f70f7add96b admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:18.000208 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.wsgi [None req-506a14df-b838-442a-980b-9f70f7add96b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 29 03:38:18.000763 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-506a14df-b838-442a-980b-9f70f7add96b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:18.001558 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-506a14df-b838-442a-980b-9f70f7add96b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058285 Jan 29 03:38:18.002049 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Jan 29 03:38:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 29 03:38:18.012054 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-7a492e19-3517-4462-90ba-712f86bd5198 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:18.025255 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-7a492e19-3517-4462-90ba-712f86bd5198 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017238 Jan 29 03:38:18.025808 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:18.035283 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-a9a6dc62-1a79-4a41-a05a-b1ea37a95d84 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:18.048375 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-a9a6dc62-1a79-4a41-a05a-b1ea37a95d84 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016811 Jan 29 03:38:18.048867 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:18.058346 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-8a2bd0ac-d873-4536-9501-cfac6e922470 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:18.063478 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.wsgi [None req-8a2bd0ac-d873-4536-9501-cfac6e922470 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 29 03:38:18.064051 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-8a2bd0ac-d873-4536-9501-cfac6e922470 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:18.064830 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-8a2bd0ac-d873-4536-9501-cfac6e922470 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010529 Jan 29 03:38:18.065349 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Jan 29 03:38:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 29 03:38:19.321750 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-a9a6dc62-1a79-4a41-a05a-b1ea37a95d84 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:19.322785 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-a9a6dc62-1a79-4a41-a05a-b1ea37a95d84 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 29 03:38:19.323182 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:19.510650 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-dc397d89-7a54-4f31-bd41-a23e2ea33e02 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:19.515705 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.wsgi [None req-dc397d89-7a54-4f31-bd41-a23e2ea33e02 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 29 03:38:19.516261 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-dc397d89-7a54-4f31-bd41-a23e2ea33e02 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:19.517044 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-dc397d89-7a54-4f31-bd41-a23e2ea33e02 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056514 Jan 29 03:38:19.517541 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:38:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 29 03:38:19.527215 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-5dd90d6b-412d-447a-9b5b-582217db32f2 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:19.540486 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-5dd90d6b-412d-447a-9b5b-582217db32f2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017288 Jan 29 03:38:19.540998 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:19.550789 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:19.563424 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016402 Jan 29 03:38:19.563942 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Jan 29 03:38:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:38:19.572543 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-4ac74da2-ae70-49ae-aa13-8239f6771acd admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:19.581359 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.wsgi [None req-4ac74da2-ae70-49ae-aa13-8239f6771acd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 29 03:38:19.581921 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-4ac74da2-ae70-49ae-aa13-8239f6771acd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:38:19.585366 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-4ac74da2-ae70-49ae-aa13-8239f6771acd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013579 Jan 29 03:38:19.585366 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:38:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 29 03:38:20.850158 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:20.851400 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Jan 29 03:38:20.851803 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:21.046372 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-8b6ac3ed-276e-4026-9962-a7abcf607dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:38:21.171436 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-8b6ac3ed-276e-4026-9962-a7abcf607dc3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.180234 Jan 29 03:38:21.172352 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Jan 29 03:38:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:38:22.434192 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:22.435192 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jan 29 03:38:22.435588 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:22.626348 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-cab13e3b-cdde-49e8-a7da-ec09ed379b4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:38:22.723990 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-cab13e3b-cdde-49e8-a7da-ec09ed379b4d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.147683 Jan 29 03:38:22.724531 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Jan 29 03:38:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:38:23.994041 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:23.995076 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jan 29 03:38:23.995467 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:24.184242 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-026058c2-8ae1-4cfa-a067-3350c9ae251d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:38:24.265778 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-026058c2-8ae1-4cfa-a067-3350c9ae251d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.133031 Jan 29 03:38:24.266354 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Jan 29 03:38:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:38:25.561059 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:25.562067 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 29 03:38:25.562492 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:25.759502 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-98b08f89-e171-436f-b6fa-6e994b179ce6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:38:25.841826 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-98b08f89-e171-436f-b6fa-6e994b179ce6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.136850 Jan 29 03:38:25.842375 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Jan 29 03:38:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:38:27.116351 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:27.117353 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 29 03:38:27.117741 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:38:27.310024 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-0ab0420e-1f57-497e-b8bf-4ec22e5eefd6 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:38:27.328716 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-0ab0420e-1f57-497e-b8bf-4ec22e5eefd6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070201 Jan 29 03:38:27.329188 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Jan 29 03:38:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:39:13.109862 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.110921 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-b98fbde4-3e76-4669-80b4-cacebe1aa747 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jan 29 03:39:13.111340 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:39:13.168038 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-cff89e48-6dd9-4bd8-9441-f1cfdaccb5ea admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.187775 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-cff89e48-6dd9-4bd8-9441-f1cfdaccb5ea admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070592 Jan 29 03:39:13.188324 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:39:13.211132 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-781628fe-7184-447e-a6bc-1ac0d2554dfd admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.218791 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-781628fe-7184-447e-a6bc-1ac0d2554dfd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Jan 29 03:39:13.219306 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:39:13.230254 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-4f5aa58f-91de-43a5-ab59-e49edc6956e0 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.237773 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-4f5aa58f-91de-43a5-ab59-e49edc6956e0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011013 Jan 29 03:39:13.238371 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:39:13.249586 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-1309be08-2790-4bf3-bc97-22c95d47757b admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.257134 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-1309be08-2790-4bf3-bc97-22c95d47757b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010968 Jan 29 03:39:13.257691 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:39:13.269222 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:39:13.277448 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011507 Jan 29 03:39:13.278068 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Sat Jan 29 03:39:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:40:51.978825 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-9a3ea4d3-0a1b-419f-8c0f-e7ac6115262a tempest-verify_tempest_config-174204818 tempest-verify_tempest_config-174204818-project] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:40:51.980757 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-9a3ea4d3-0a1b-419f-8c0f-e7ac6115262a tempest-verify_tempest_config-174204818 tempest-verify_tempest_config-174204818-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103973 Jan 29 03:40:51.981281 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jan 29 03:40:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:42:20.704253 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:20.705390 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jan 29 03:42:20.705838 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:42:20.972688 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:20.973881 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:42:20.973881 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:42:20.975922 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:20.976362 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:20.977172 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:20.977595 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:21.011423 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-f36d9de8-d2b2-4e82-85a8-bd5735a6951d admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159994 Jan 29 03:42:21.011965 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:42:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:42:22.296688 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:22.297687 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Jan 29 03:42:22.298142 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:42:22.495765 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:22.497027 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:42:22.497027 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:42:22.498688 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:22.499168 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:22.499981 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:22.500471 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:22.520261 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-1b7fa148-19b1-4edd-bac7-ad7b87a68965 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077929 Jan 29 03:42:22.524068 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:42:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:42:34.227506 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:34.227506 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 29 03:42:34.227506 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:42:34.422064 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:34.423431 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:42:34.423431 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:42:34.424963 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:34.425413 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:34.426251 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:34.426686 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:34.451523 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-15e2d3e0-7092-4044-bc97-419c8f91d355 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080799 Jan 29 03:42:34.452091 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 37/75] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:42:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:42:35.744857 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: DEBUG nova.api.openstack.wsgi [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] Calling method '>' {{(pid=108809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:35.745844 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: INFO nova.api.openstack.requestlog [None req-487e494e-7916-4837-92bb-1b8a4825fce7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jan 29 03:42:35.746276 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: [pid: 108809|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Jan 29 03:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:42:35.953332 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG nova.api.openstack.wsgi [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] Calling method '>' {{(pid=108808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:42:35.954582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:42:35.954582 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: warnings.warn(msg) Jan 29 03:42:35.956195 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:35.956589 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:35.957388 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:42:35.957820 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: DEBUG oslo_concurrency.lockutils [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:42:35.979163 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: INFO nova.api.openstack.requestlog [None req-27f2471c-e6bb-40f1-8500-b913566d8968 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082731 Jan 29 03:42:35.979713 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: [pid: 108808|app: 0|req: 38/77] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Jan 29 03:42:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:43:32.918001 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: Sat Jan 29 03:43:32 2022 - graceful shutdown triggered... Jan 29 03:43:32.918556 dv-cinder-826949-1-iscsi devstack@n-api.service[108809]: Gracefully killing worker 2 (pid: 108809)... Jan 29 03:43:32.918163 dv-cinder-826949-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 29 03:43:32.919378 dv-cinder-826949-1-iscsi devstack@n-api.service[108808]: Gracefully killing worker 1 (pid: 108808)... Jan 29 03:43:33.918256 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: worker 1 buried after 1 seconds Jan 29 03:43:33.918663 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: worker 2 buried after 1 seconds Jan 29 03:43:33.918663 dv-cinder-826949-1-iscsi devstack@n-api.service[108807]: goodbye to uWSGI. Jan 29 03:43:33.919783 dv-cinder-826949-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 29 03:43:33.920329 dv-cinder-826949-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 29 03:43:33.923150 dv-cinder-826949-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 29 03:43:33.935053 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 29 03:43:33 2022] *** Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: nodename: dv-cinder-826949-1-iscsi Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: machine: x86_64 Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: clock source: unix Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: pcre jit disabled Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: detected number of CPU cores: 4 Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: current working directory: / Jan 29 03:43:33.937027 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: detected binary path: /usr/bin/uwsgi-core Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: your processes number limit is 47680 Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: your memory page size is 4096 bytes Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: detected max file descriptor number: 2048 Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: lock engine: pthread robust mutexes Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: thunder lock: enabled Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 29 03:43:33.937764 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 29 03:43:33.986321 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: Python main interpreter initialized at 0x55736928b9c0 Jan 29 03:43:33.986321 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: python threads support enabled Jan 29 03:43:33.986321 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: your server socket listen backlog is limited to 100 connections Jan 29 03:43:33.986321 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: your mercy for graceful operations on workers is 90 seconds Jan 29 03:43:33.986776 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: mapped 403077 bytes (393 KB) for 2 cores Jan 29 03:43:33.986776 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: *** Operational MODE: preforking *** Jan 29 03:43:33.987078 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: *** uWSGI is running in multiple interpreter mode *** Jan 29 03:43:33.987078 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: spawned uWSGI master process (pid: 123233) Jan 29 03:43:33.987786 dv-cinder-826949-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 29 03:43:33.988378 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: spawned uWSGI worker 1 (pid: 123253, cores: 1) Jan 29 03:43:33.988742 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: spawned uWSGI worker 2 (pid: 123254, cores: 1) Jan 29 03:43:33.989654 dv-cinder-826949-1-iscsi devstack@n-api.service[123233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 29 03:43:35.951064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:43:35.951064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: from cryptography.utils import int_from_bytes Jan 29 03:43:35.951727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:43:35.951727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: from cryptography.utils import int_from_bytes Jan 29 03:43:35.954084 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:43:35.954084 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: from cryptography.utils import int_from_bytes Jan 29 03:43:35.954603 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 29 03:43:35.954603 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: from cryptography.utils import int_from_bytes Jan 29 03:43:38.393138 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 29 03:43:38.394390 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 29 03:43:38.394669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 29 03:43:38.394883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 29 03:43:38.395144 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 29 03:43:38.395541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.395881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.396211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.397298 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.397829 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.398343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.398687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.399020 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.399361 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.399898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.400226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.400559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826949-1-iscsi {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.400890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.401206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.401524 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.401850 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.402247 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.402584 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.402905 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.403408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.404815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.404815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.404815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.404815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.405153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.405411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.405730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.406058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.406416 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.406737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.407145 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826949-1-iscsi {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.407473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.407795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.408118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.408551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.408878 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.409210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.409539 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.409871 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.410213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.410727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.411227 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.411708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.412200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.412514 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.412835 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.413156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.413486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.413801 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.414115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.414400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.414721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.415052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.415382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.415567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 29 03:43:38.415992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.416081 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 29 03:43:38.416155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.416238 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.416321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 29 03:43:38.416513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.416699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 29 03:43:38.416966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 29 03:43:38.417070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.417329 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.417432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.417647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.417752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.417966 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.418309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.418638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.418869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.418992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.419257 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.419571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.419900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.420226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.420572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.420872 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.421082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.421448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.421624 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.421782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.421936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422456 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.422953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423117 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423266 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423431 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826949-1-iscsi {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.423886 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.424041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.424196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.424348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425552 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.425854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426010 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426206 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426528 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426683 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.426993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427456 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427703 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.427944 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428074 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428586 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.428963 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429555 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.429937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.430122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.445476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.445687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.445844 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826949-1-iscsi {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446204 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446360 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446825 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.446973 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447142 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447291 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447601 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.447911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448209 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.448978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.449150 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.449404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.449582 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.449818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.449981 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.450182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.450341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.450488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.450645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.450795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.451015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.451779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.452543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.452708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.452866 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453172 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453472 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453677 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453837 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.453996 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454497 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.454960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455114 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455591 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455739 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.455933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.456112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.456881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457052 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457672 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.457954 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458110 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458304 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.458920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.459359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.459638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.459638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.459638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.459638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.459638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.460483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.460631 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.460795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.460953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.461111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.461285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.461984 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.462267 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.462433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.462582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.462736 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.462883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.462883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.463167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.463327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.463484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.463650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.463805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.463952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.464098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.464259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.464490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.464645 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.464792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.464946 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.465107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.465269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.465423 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.465570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.465734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.465888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.466043 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.466241 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.466394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.466579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.466726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.466880 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.467041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.467198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.467345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.467491 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.467638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.467638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.467994 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.468195 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468282 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.468373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468470 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.468551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.468721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.468890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.468988 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469074 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469260 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469812 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469897 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.469994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.469994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.477094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477200 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.477296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.477487 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477487 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.477726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477810 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.477894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.477987 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.478082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.478186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.478274 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.478358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.478460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.478554 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.478646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.478740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.478825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.478917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.479012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.479106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.479199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.479333 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.479422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.479505 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.479596 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.479688 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.479817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.479921 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.480111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480208 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.480295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480391 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.480484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.480668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480752 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.480843 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.480935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.481112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481199 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.481282 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481373 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.481459 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.481638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481751 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.481854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.481948 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.482273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482467 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.482569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.482750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.483636 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.483812 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483812 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.483978 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.484147 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484230 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.484315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.484500 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484593 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.484686 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.484865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.484958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.485211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 03:43:38.485386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.485998 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486371 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486776 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486861 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.486953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.487045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.487675 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.487764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.487857 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.487942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488125 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488325 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488509 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488592 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.488934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489363 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489548 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489723 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489821 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489908 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.489988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490212 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490509 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490780 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.490933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491015 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491095 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491423 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.491974 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492046 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492142 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492389 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492712 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492784 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.492925 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493003 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493218 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493452 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493602 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493751 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.493903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494111 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494302 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.494854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496145 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496241 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496613 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.496685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.497983 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498076 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498234 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498465 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498617 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498767 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.498990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499283 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499475 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499821 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.499913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500286 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500510 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500801 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500872 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.500942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501270 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.501968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.502153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.502533 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.503400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.503517 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.503686 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.503822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504015 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504159 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504531 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.504864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505010 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.505859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506013 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506208 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506358 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506536 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.506995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.507960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.508913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.509138 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.509231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.509489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.509588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.509807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510012 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510233 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510563 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510878 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.510977 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511610 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.511943 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512260 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512535 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512647 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.512881 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513758 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.513862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514565 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.514909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515219 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515542 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515767 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.515862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516076 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516429 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516536 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.516800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517114 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.517964 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.518159 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.518334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.518537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.518659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.518910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519013 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519666 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.519973 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520204 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.520920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521457 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.521868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522219 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522738 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.522854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.523994 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.524093 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.524312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.524402 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.524881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.524980 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525193 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525622 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525844 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.525942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526177 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526283 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526593 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.526916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527128 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527225 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.527850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528078 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528176 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.528796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.529965 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530409 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530617 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530716 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.530934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531343 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531564 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.531976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532207 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.532953 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533314 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.533910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534299 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.534942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535267 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.535908 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536238 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536561 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536773 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.536863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537098 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537739 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.537851 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538048 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538265 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538717 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.538813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539033 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539671 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.539997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.540177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.540329 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.540585 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.540695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.540934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541369 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541653 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.541968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.542209 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.542303 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.542531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.542620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.542929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543171 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543492 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543810 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.543910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544126 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544217 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544761 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.544863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545212 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545402 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.545818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546122 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.546830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547157 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547371 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547469 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547696 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.547815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548014 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548432 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548749 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.548992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.549096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.549315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.549449 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.550915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551268 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551588 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551837 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.551966 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552168 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552272 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.552893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553443 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.553856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554510 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554738 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.554843 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555180 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.555800 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556438 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.556982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557125 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557443 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557626 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557773 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.557953 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558459 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558619 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.558934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.559893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560401 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560531 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.560858 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561698 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.561806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562467 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.562837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563716 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.563813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564124 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564664 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.564982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.565072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.565825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.565965 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566230 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566800 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.566899 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567443 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.567898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568381 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.568792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569008 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.569740 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570016 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570625 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.570955 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571272 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571370 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.571989 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572653 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.572963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573204 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573540 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.573954 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574529 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.574937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575673 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.575935 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576517 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576870 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.576963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577068 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.577781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578110 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578831 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.578997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579151 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579475 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579785 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.579972 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.580104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.580289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.580426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.580601 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.580750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.581422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.581593 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.581734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.581919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582084 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582271 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582416 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582757 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.582917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.583089 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.583364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.583462 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.583690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.583791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584671 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584761 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.584989 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585190 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585739 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.585963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586635 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.586953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587277 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.587924 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.588084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.588411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.588510 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.588740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.588837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589709 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.589804 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590031 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590121 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590723 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.590822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591134 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.591783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592351 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592735 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.592956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593053 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593608 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.593933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594395 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.594977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595291 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595403 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595614 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595713 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.595939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.596038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.596263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.596402 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597150 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.597942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598192 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598838 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.598930 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599161 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.599905 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600550 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.600956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.601987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.602257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.602352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.602583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.602766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.602920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603260 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603358 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603741 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.603916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604238 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604330 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.604961 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605279 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605504 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605608 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.605917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606153 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606482 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.606885 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607753 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.607974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608747 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.608989 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609324 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.609959 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.610950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611367 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611596 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611686 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.611909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612342 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.612986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613514 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613613 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613829 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.613940 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.614954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615275 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615432 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.615846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616481 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.616992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617712 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.617932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618029 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618277 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618592 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618688 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.618909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619052 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619251 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619540 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619858 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.619967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620166 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.620932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621266 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621452 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.621945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.622121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.622364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.622485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.622642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.623586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.623718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.623858 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.623961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624036 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624209 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624302 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624395 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.624954 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625480 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.625928 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.626179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.626290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.626587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.626711 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.626906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627052 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.627887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.628851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629351 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629492 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.629846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630012 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.630836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631019 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.631832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.632823 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633049 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633367 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.633773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634185 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634762 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.634880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635203 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.635842 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.636802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637019 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637449 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637686 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.637778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638114 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638375 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.638781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639149 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639851 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.639943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.640957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641282 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641834 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.641936 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642594 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642820 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.642911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.643134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.643269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.643975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644067 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.644929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645557 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645875 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.645967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.646232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.646447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.646567 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.646808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.646900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647230 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.647921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648136 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648225 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648455 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648786 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.648875 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.649105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.649203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.649425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.649810 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.650986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651409 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.651946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652037 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652265 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.652921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.653960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.654218 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.654356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.654531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.654620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.654777 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 29 03:43:38.654870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.655146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.655460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.655785 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.656100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.656421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.656736 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.657058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.657374 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.657695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.658015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.658372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.658692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.659065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.659893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.660220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.660553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.660876 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.661201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.661555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.661882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.662509 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.662864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.663201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.663548 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.663890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.664210 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.664527 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.664845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.665179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.665503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.665826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.666166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.666491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.666814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.667136 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.667455 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.667783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.668109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.668428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.668747 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.669071 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.669421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.669750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.670079 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.670433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.670761 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.671082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.671420 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.671756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.672073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.672400 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.672738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.673120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.674249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.674737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.675091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.675422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.675765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.676098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.676440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.676780 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.677122 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.677451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.677777 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.678141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.678505 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.678849 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.679191 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.679400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_db.sqlalchemy.engines [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.679502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.679815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.680131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.680457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.680802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.681148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.681478 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.681814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.682153 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.682494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.682816 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.683251 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.683589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.683921 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.684243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.684584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.684904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.685228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.685554 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.685878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.686224 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.686549 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.686887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.687227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.687546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.687890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.688222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.688555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.688881 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.689206 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.689546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.689875 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.690253 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.690581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.690909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.691240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.691568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.691906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.692361 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.692999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.693588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.693956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.694324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.694690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.695060 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.695391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.695719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.696039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 03:43:38.696296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 29 03:43:38.725075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_db.sqlalchemy.engines [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.750695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.context [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56d64fc2-fc63-462e-9bec-aa175bb73d4b(cell1) {{(pid=123254) load_cells /opt/stack/nova/nova/context.py:464}} Jan 29 03:43:38.755442 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:43:38.757017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:43:38.757833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:43:38.759789 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:43:38.770802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_db.sqlalchemy.engines [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.781073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_db.sqlalchemy.engines [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.790855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.context [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56d64fc2-fc63-462e-9bec-aa175bb73d4b(cell1) {{(pid=123253) load_cells /opt/stack/nova/nova/context.py:464}} Jan 29 03:43:38.795160 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:43:38.796756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:43:38.797574 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:43:38.799582 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:43:38.810178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_db.sqlalchemy.engines [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.811163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_db.sqlalchemy.engines [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.935336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_db.sqlalchemy.engines [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:38.976396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_db.sqlalchemy.engines [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 03:43:39.255342 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: WARNING keystonemiddleware.auth_token [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:43:39.262495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: WARNING keystonemiddleware.auth_token [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:43:39.314302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: WARNING keystonemiddleware.auth_token [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:43:39.322213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: WARNING keystonemiddleware.auth_token [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:43:39.604922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: WARNING keystonemiddleware.auth_token [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:43:39.610868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: WARNING keystonemiddleware.auth_token [None req-260ea249-eb4f-46ff-a42e-bdd32ff5f642 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:43:39.616293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55736928b9c0 pid: 123254 (default app) Jan 29 03:43:39.669514 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: WARNING keystonemiddleware.auth_token [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 29 03:43:39.674814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: WARNING keystonemiddleware.auth_token [None req-949ef111-0502-40bc-b57e-f12c7d2885e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 29 03:43:39.680222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55736928b9c0 pid: 123253 (default app) Jan 29 03:44:17.059181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5de99c44-69c7-4b2b-ab47-22d000c3365a tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Action: 'create', calling method: .version_select at 0x7f450299ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-423505027"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:17.503267 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1660901328", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "8ecf2438-eca5-4dd8-92b6-936ee7f74d5d"}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:17.841565 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] validate_networks() for [('8ecf2438-eca5-4dd8-92b6-936ee7f74d5d', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:18.581048 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5de99c44-69c7-4b2b-ab47-22d000c3365a tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.331387 Jan 29 03:44:18.582766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1154 bytes} [Sat Jan 29 03:44:16 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2336 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 29 03:44:18.590385 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f87213ba-a6a2-475d-99d4-9d96e6fee9c6 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f4502869790>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:18.652614 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f87213ba-a6a2-475d-99d4-9d96e6fee9c6 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a85a8fce-a675-48fb-96c1-533346394e5c" status: 200 len: 350 microversion: 2.1 time: 0.068420 Jan 29 03:44:18.653171 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:18 2022] GET /compute/v2.1/os-volumes/a85a8fce-a675-48fb-96c1-533346394e5c => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:18.658577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8e6b518f-1ff0-4f08-a451-843254bc37bd tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4502869d30>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:18.798637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8e6b518f-1ff0-4f08-a451-843254bc37bd tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 200 len: 344 microversion: 2.1 time: 0.139617 Jan 29 03:44:18.798637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:18 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:18.976719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:18.977478 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:18.977586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:18.978039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:18.978521 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:19.015981 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:19.016505 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:19.017411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:19.017852 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:19.157629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Getting quotas for project 654101f4db1547ce8e1bea070af930d9. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:19.157629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Getting quotas for user 7390fc7d883040ebbcb78b4a12c13bad and project 654101f4db1547ce8e1bea070af930d9. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:19.208145 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:19.223651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:19.247690 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-416048720", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "4191093a-3e75-431e-ba6a-0a5e62dd1238"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:19.395065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] validate_networks() for [('4191093a-3e75-431e-ba6a-0a5e62dd1238', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:19.459286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a30d70cc-1d49-474c-a60c-d78b6992f424 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.496054 Jan 29 03:44:19.460207 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 1/4] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:44:19.472385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9f723669-7c27-413e-bf93-7ca8646067e3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:19.473057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9f723669-7c27-413e-bf93-7ca8646067e3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:19.658805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9f723669-7c27-413e-bf93-7ca8646067e3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:19.682695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9f723669-7c27-413e-bf93-7ca8646067e3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1215 microversion: 2.1 time: 0.215214 Jan 29 03:44:19.696123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:19 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:19.813591 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e5342113-5972-41ab-b667-4c58d3056b42 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4501740160>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:19.985020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e5342113-5972-41ab-b667-4c58d3056b42 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 200 len: 345 microversion: 2.1 time: 0.176310 Jan 29 03:44:19.987129 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:19 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:19.998737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-41a73077-12a3-40af-a5ad-8099f060c0c2 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Action: 'create', calling method: .version_select at 0x7f4501740ee0>, body: {"snapshot": {"volume_id": "605734fe-1406-4b5b-a9f3-e642501b5e2f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1629236104"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:20.828033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-41a73077-12a3-40af-a5ad-8099f060c0c2 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.833240 Jan 29 03:44:20.831211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Jan 29 03:44:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:20.844321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d39ac96e-2141-4a10-9b10-81ae07c25a18 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:20.845918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d39ac96e-2141-4a10-9b10-81ae07c25a18 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:20.971302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d39ac96e-2141-4a10-9b10-81ae07c25a18 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:20.981305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:20.981759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d39ac96e-2141-4a10-9b10-81ae07c25a18 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1215 microversion: 2.1 time: 0.149289 Jan 29 03:44:20.982366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:20 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:20.982609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:20.983288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:20.983997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:20.984610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:20.990731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e98be83d-3d1b-44be-b612-5beb95662b49 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016a9e50>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:21.025039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e98be83d-3d1b-44be-b612-5beb95662b49 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.041626 Jan 29 03:44:21.025607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 6/9] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:20 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:21.030749 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:21.031208 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:21.032121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:21.032561 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:21.033489 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1eae5907-bc9b-458c-8210-6bb96ee98584 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f45016ba1f0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:21.091927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:21.114399 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for user 82e533dc110e44f0af37569d8c1b8522 and project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:21.130187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:21.133980 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:21.233658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1eae5907-bc9b-458c-8210-6bb96ee98584 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fbf5a8ca-c0c3-47b1-9621-017da67750b1" status: 200 len: 350 microversion: 2.1 time: 0.206997 Jan 29 03:44:21.234855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 7/10] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:21 2022] GET /compute/v2.1/os-volumes/fbf5a8ca-c0c3-47b1-9621-017da67750b1 => generated 350 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:21.250648 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b149cd6f-5efe-4e5d-8615-3a280b00dee5 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016bad30>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:21.450828 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-11d4e0ea-3d97-4ee2-98bb-158bf7ddfff5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.315917 Jan 29 03:44:21.451849 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 4/11] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 29 03:44:21.463226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-948e1fa8-90e1-492a-b81d-ed0ec0eaa49b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:21.463875 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-948e1fa8-90e1-492a-b81d-ed0ec0eaa49b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:21.571055 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b149cd6f-5efe-4e5d-8615-3a280b00dee5 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.334814 Jan 29 03:44:21.571770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 8/12] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Jan 29 03:44:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:21.586059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-84ac2e5d-70f6-4423-995b-f86f2dd63486 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016a9e50>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:21.667456 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-84ac2e5d-70f6-4423-995b-f86f2dd63486 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.089015 Jan 29 03:44:21.676120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 9/13] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:21 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:44:21.703917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-948e1fa8-90e1-492a-b81d-ed0ec0eaa49b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:21.737184 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-948e1fa8-90e1-492a-b81d-ed0ec0eaa49b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1217 microversion: 2.1 time: 0.278886 Jan 29 03:44:21.738104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 5/14] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:21 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:21.999482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3a1c1723-eb35-4098-8064-4d24b35c34a3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:22.000758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3a1c1723-eb35-4098-8064-4d24b35c34a3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:22.111102 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3a1c1723-eb35-4098-8064-4d24b35c34a3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:22.123364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3a1c1723-eb35-4098-8064-4d24b35c34a3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1215 microversion: 2.1 time: 0.127808 Jan 29 03:44:22.126980 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:21 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:22.689560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dbfc3a7e-80db-4c0c-98ad-5a85f981b001 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4501f22c10>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:22.742561 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dbfc3a7e-80db-4c0c-98ad-5a85f981b001 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.058324 Jan 29 03:44:22.748438 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 6/16] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:22 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:22.758613 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-37c46cb5-53a3-4264-a785-d06a2840f832 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:22.760850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-37c46cb5-53a3-4264-a785-d06a2840f832 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:22.896340 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-37c46cb5-53a3-4264-a785-d06a2840f832 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:22.913748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-37c46cb5-53a3-4264-a785-d06a2840f832 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1217 microversion: 2.1 time: 0.163393 Jan 29 03:44:22.918662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 11/17] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:22 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:23.145796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:23.146768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:23.157450 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:23.158165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:23.159188 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:23.159782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:23.530562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:23.574968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1eb01391-5386-453a-8c68-1ce49a191522 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1219 microversion: 2.1 time: 0.435013 Jan 29 03:44:23.577105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 7/18] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:23 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1219 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:23.755067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a9b2a495-73e1-4596-932b-94ff41028548 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016ba820>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:23.824032 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a9b2a495-73e1-4596-932b-94ff41028548 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.073462 Jan 29 03:44:23.828545 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 12/19] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:23 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:23.930595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:23.931848 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:23.937793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:23.938512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:23.939522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:23.940117 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:24.044256 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:24.048475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b1c64ef6-00e6-4f99-9fcb-4836085b100e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1221 microversion: 2.1 time: 0.119511 Jan 29 03:44:24.049877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 8/20] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:23 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:24.695712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:24.695712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:24.695712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:24.695712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:24.697793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:24.697793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:24.836311 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a1424387-776d-4485-923e-8a1f98be9e4a tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f450164e0d0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:24.926919 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a1424387-776d-4485-923e-8a1f98be9e4a tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.094368 Jan 29 03:44:24.927754 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 9/21] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:24 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:44:25.065694 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:25.066969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:25.074891 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:25.075551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:25.076545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:25.077148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:25.104088 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:25.127867 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-22868bd3-7a98-4531-9363-f9c68f64c725 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1219 microversion: 2.1 time: 0.537260 Jan 29 03:44:25.128705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:24 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1219 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:25.193195 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:25.211413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-eb775af4-3648-4499-bf5f-2b1a0baffd0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1221 microversion: 2.1 time: 0.149354 Jan 29 03:44:25.213114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:25 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:25.492370 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6f90f2fb-9ce3-4fd5-9fa0-6f42d568a2b2 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f45016398b0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:25.592592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6f90f2fb-9ce3-4fd5-9fa0-6f42d568a2b2 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/87cea19f-294a-4df1-a754-9c8d938618d4" status: 200 len: 350 microversion: 2.1 time: 0.104862 Jan 29 03:44:25.593896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 14/24] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:25 2022] GET /compute/v2.1/os-volumes/87cea19f-294a-4df1-a754-9c8d938618d4 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:25.607011 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1ad3a5e2-b005-45a7-86b1-3757e8437c19 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f450169ddc0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:25.749134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1ad3a5e2-b005-45a7-86b1-3757e8437c19 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.145802 Jan 29 03:44:25.749875 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 11/25] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jan 29 03:44:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:25.763794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bde5989f-ddc3-4444-b569-c88cf13e248c tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f4501659280>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:25.940005 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fc61415f-f2fb-40dc-a495-49c4b1fb5a17 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45015f2b80>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.018098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bde5989f-ddc3-4444-b569-c88cf13e248c tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.259741 Jan 29 03:44:26.019354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 15/26] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Jan 29 03:44:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:26.036808 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fc61415f-f2fb-40dc-a495-49c4b1fb5a17 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 288 microversion: 2.1 time: 0.095155 Jan 29 03:44:26.037600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3dc729f8-3ef5-403c-b181-bd4d06c76d57 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f45016ba160>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.037714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:25 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:44:26.045704 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1c13ff7c-cd6d-4736-8c36-4d16558c4079 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4501639f70>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.312587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1c13ff7c-cd6d-4736-8c36-4d16558c4079 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 202 len: 0 microversion: 2.1 time: 0.270024 Jan 29 03:44:26.314654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jan 29 03:44:26 2022] DELETE /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:44:26.321922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.322990 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:26.346503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:26.348702 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:26.353883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:26.355336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:26.520515 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3dc729f8-3ef5-403c-b181-bd4d06c76d57 tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.492118 Jan 29 03:44:26.521883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:26.527625 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.528668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:26.553674 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:26.554501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:26.555685 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:26.557105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:26.577602 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:26.600714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-152e7196-93c6-4ad5-bb79-867493d753ba tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1275 microversion: 2.1 time: 0.284687 Jan 29 03:44:26.601316 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 14/30] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:26.622333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-eb16e865-d2e7-49e4-bc7d-a7a5fa5fe372 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45015f9f70>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.689420 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-eb16e865-d2e7-49e4-bc7d-a7a5fa5fe372 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 200 len: 287 microversion: 2.1 time: 0.087010 Jan 29 03:44:26.694119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 15/31] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:26.699527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-74f9d784-6fb1-49b3-a8d3-d94db483443e tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f4501609550>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.824674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-74f9d784-6fb1-49b3-a8d3-d94db483443e tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127562 Jan 29 03:44:26.836756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:26.885183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:26.899737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4152a346-90ad-4d2c-9bc6-1585e08e045f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1277 microversion: 2.1 time: 0.372260 Jan 29 03:44:26.901746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:26.915956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-07236c77-b9dc-46b0-8a7f-58275df3191e tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f4501636dc0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:26.964056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: .version_select at 0x7f4501639310>, body: {"keypair": {"name": "tempest-keypair-407818180"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:27.018886 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:27.032678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:27.173992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-07236c77-b9dc-46b0-8a7f-58275df3191e tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.269203 Jan 29 03:44:27.174784 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Jan 29 03:44:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:27.193847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f8723859-cd64-4439-aaac-41aa54a3766f tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f45015f7dc0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.507328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f8723859-cd64-4439-aaac-41aa54a3766f tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.323936 Jan 29 03:44:27.508205 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 19/35] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:27.519183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-519b03a2-365f-4e12-b9db-7b3ffe3f9e8c tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f45015f7e50>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.593639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:27.610320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:27.647764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ff124817-50b7-40aa-a3fb-cccc61f6df4b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.809137 Jan 29 03:44:27.648825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 17/36] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Jan 29 03:44:26 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 811 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 29 03:44:27.668294 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.668922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:27.681947 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:27.682446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:27.687188 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:27.687658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:27.728838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-519b03a2-365f-4e12-b9db-7b3ffe3f9e8c tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.213586 Jan 29 03:44:27.729731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1187 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:27.736724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2c0d7083-42d2-4a1f-a326-f36d969d5ff1 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016c4940>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.779032 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-2c0d7083-42d2-4a1f-a326-f36d969d5ff1 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] HTTP exception thrown: Snapshot 388a4d9c-f993-489e-965d-1ade4669ed8d could not be found. Jan 29 03:44:27.779745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2c0d7083-42d2-4a1f-a326-f36d969d5ff1 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Returning 404 to user: Snapshot 388a4d9c-f993-489e-965d-1ade4669ed8d could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:44:27.780905 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2c0d7083-42d2-4a1f-a326-f36d969d5ff1 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d" status: 404 len: 111 microversion: 2.1 time: 0.049978 Jan 29 03:44:27.781453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/os-snapshots/388a4d9c-f993-489e-965d-1ade4669ed8d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:44:27.787504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8e85cbf4-cb6a-4556-baf4-c51f31cd54ff tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] Calling method '.version_select at 0x7f450278fb80>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.840073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:27.849449 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cfd8eb07-94c2-4b69-be88-b63161d8fe02 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1273 microversion: 2.1 time: 0.190585 Jan 29 03:44:27.852588 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 18/39] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:27.864180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-050a0df7-f472-4f6e-b5c1-3d69b6670221 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45015c8040>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.955476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8e85cbf4-cb6a-4556-baf4-c51f31cd54ff tempest-VolumesTestJSON-986448644 tempest-VolumesTestJSON-986448644-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.172767 Jan 29 03:44:27.956244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:27.960759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:27.961942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:27.981288 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:27.982910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:27.990638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:27.990638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:28.174686 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-050a0df7-f472-4f6e-b5c1-3d69b6670221 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 202 len: 0 microversion: 2.1 time: 0.320827 Jan 29 03:44:28.175382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 19/41] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:44:27 2022] DELETE /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:44:28.184398 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d9e15cbb-fbb7-4698-8196-828899ffc2af tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45015c8b80>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:28.294032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d9e15cbb-fbb7-4698-8196-828899ffc2af tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 200 len: 344 microversion: 2.1 time: 0.114081 Jan 29 03:44:28.308779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:28 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:28.430322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:28.444370 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-feb228fc-15b8-4c23-8221-d15279c6b43d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1275 microversion: 2.1 time: 0.487032 Jan 29 03:44:28.444963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:27 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:28.870946 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:28.872214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:28.888775 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:28.893103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:28.894156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:28.894792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:29.207459 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:29.242210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2478d641-1c7d-4d32-b878-1fe0e7561ee8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1273 microversion: 2.1 time: 0.375154 Jan 29 03:44:29.245003 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 21/44] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:28 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:29.309864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e3c25831-c915-4520-830c-e855f2c72dcd tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016c4430>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:29.471057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e3c25831-c915-4520-830c-e855f2c72dcd tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 200 len: 344 microversion: 2.1 time: 0.165280 Jan 29 03:44:29.472349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 24/45] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:29 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:29.478934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:29.479899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:29.498079 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:29.498685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:29.505709 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:29.506192 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:29.646489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:29.672750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-05afda7b-6802-460e-954f-fc090c595ed3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1275 microversion: 2.1 time: 0.198807 Jan 29 03:44:29.682566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 22/46] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:29 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:30.265869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:30.268672 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:30.304067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:30.305312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:30.309814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:30.312332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:30.483950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-39ea6009-a02e-42a1-be84-b3710bf09687 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45015f20d0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:30.696198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-39ea6009-a02e-42a1-be84-b3710bf09687 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 200 len: 344 microversion: 2.1 time: 0.215412 Jan 29 03:44:30.703060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:30 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:30.704822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:30.707122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:30.729169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:30.737794 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:30.738766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:30.743059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:31.207311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:31.233562 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-69f47448-a615-481a-9f63-dc0113fddc1f tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.977137 Jan 29 03:44:31.241170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:30 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:31.713704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-42763ba2-6d94-43c7-8551-30f1571bda37 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f45016188b0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:31.891898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-42763ba2-6d94-43c7-8551-30f1571bda37 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] HTTP exception thrown: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. Jan 29 03:44:31.891898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-42763ba2-6d94-43c7-8551-30f1571bda37 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Returning 404 to user: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:44:31.891898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-42763ba2-6d94-43c7-8551-30f1571bda37 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 404 len: 109 microversion: 2.1 time: 0.157506 Jan 29 03:44:31.891898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 26/49] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:31 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 03:44:31.897133 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-caf4c2b4-f6c8-4560-838b-06a49dec8437 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4501636d30>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:32.066024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-caf4c2b4-f6c8-4560-838b-06a49dec8437 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] HTTP exception thrown: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. Jan 29 03:44:32.068660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-caf4c2b4-f6c8-4560-838b-06a49dec8437 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Returning 404 to user: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:44:32.068660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-caf4c2b4-f6c8-4560-838b-06a49dec8437 tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 404 len: 109 microversion: 2.1 time: 0.178728 Jan 29 03:44:32.073072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 27/50] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:44:31 2022] DELETE /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 03:44:32.208038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-613793532", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:32.366289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] validate_networks() for [('def124bd-d2cb-4303-acf8-363c1eeee992', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:32.935299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:32.944565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-37b7cf13-49eb-4011-ac91-1a145e928ab7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 2.244689 Jan 29 03:44:32.948211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 24/51] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:30 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:32.955908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a172599f-e8d9-4770-bdf8-992dd599531b tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Calling method '.version_select at 0x7f4501654310>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:33.041219 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-a172599f-e8d9-4770-bdf8-992dd599531b tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] HTTP exception thrown: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. Jan 29 03:44:33.042191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a172599f-e8d9-4770-bdf8-992dd599531b tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] Returning 404 to user: Volume 605734fe-1406-4b5b-a9f3-e642501b5e2f could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:44:33.043456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a172599f-e8d9-4770-bdf8-992dd599531b tempest-VolumesSnapshotsTestJSON-1030849540 tempest-VolumesSnapshotsTestJSON-1030849540-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f" status: 404 len: 109 microversion: 2.1 time: 0.093220 Jan 29 03:44:33.044268 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 25/52] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:44:32 2022] GET /compute/v2.1/os-volumes/605734fe-1406-4b5b-a9f3-e642501b5e2f => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:44:33.058026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:33.067269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:33.096290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:33.102393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:33.102393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:33.102393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:34.094799 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:34.106952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ad777c8d-fce7-443f-bcb3-6263c1ba6944 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 1.061456 Jan 29 03:44:34.114321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:33 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:34.613934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:34.614550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:34.614941 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:34.615802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:34.616429 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:34.638829 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:34.639284 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:34.645070 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:34.645604 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:34.698881 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Getting quotas for project 995678f3901441a099ca67990ffaa293. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:34.710524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Getting quotas for user d27a0c13cce84006bd75226460140783 and project 995678f3901441a099ca67990ffaa293. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:34.754273 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:34.754273 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:34.769498 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: .version_select at 0x7f4501639a60>, body: {"keypair": {"name": "tempest-keypair-1150490258"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:34.840461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:34.845625 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:34.914596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6ba11842-21a7-4e07-872f-bd91e094a40a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.839936 Jan 29 03:44:34.915223 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:44:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:44:34.929582 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:34.932428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:34.949387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:34.950297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:34.951573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:34.954697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:35.941581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:35.973115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:36.039931 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:36.045130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-34850e2e-a417-47ef-901d-022333af1d5d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.930372 Jan 29 03:44:36.047970 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 27/55] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Jan 29 03:44:34 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:36.058087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-518a1953-16be-4395-a199-1555c9ed681c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 1.138236 Jan 29 03:44:36.062293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 29/56] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:34 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:36.062407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-713c32de-5aaa-4183-8d2b-298a9045999c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:36.066862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-713c32de-5aaa-4183-8d2b-298a9045999c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:36.100957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:36.101898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:36.136111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:36.142975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:36.144270 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:36.146368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:36.476402 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-713c32de-5aaa-4183-8d2b-298a9045999c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:36.499357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-713c32de-5aaa-4183-8d2b-298a9045999c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1221 microversion: 2.1 time: 0.445153 Jan 29 03:44:36.502026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 28/57] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:36 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1221 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:36.711069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-343f7a92-45bb-4594-bb7d-cfca6c665a3b req-066a6ef8-2bee-46f9-a74f-5c7c760d1a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0238dfa-64ff-4122-8f56-0f4430b66bbb", "tag": "344261af-89bd-4849-88f4-09b55da6299e"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:36.713548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:36.713548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:44:36.749851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-343f7a92-45bb-4594-bb7d-cfca6c665a3b req-066a6ef8-2bee-46f9-a74f-5c7c760d1a2d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:36.759888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-343f7a92-45bb-4594-bb7d-cfca6c665a3b req-066a6ef8-2bee-46f9-a74f-5c7c760d1a2d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:36.789102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-343f7a92-45bb-4594-bb7d-cfca6c665a3b req-066a6ef8-2bee-46f9-a74f-5c7c760d1a2d service nova] Creating event network-changed:344261af-89bd-4849-88f4-09b55da6299e for instance d0238dfa-64ff-4122-8f56-0f4430b66bbb on hv-cinder-82694 Jan 29 03:44:36.794289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-343f7a92-45bb-4594-bb7d-cfca6c665a3b req-066a6ef8-2bee-46f9-a74f-5c7c760d1a2d service nova] Acquired lock "compute-rpcapi-router" {{(pid=123254) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 29 03:44:36.794289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:36.794289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:36.794289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:36.795854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:36.808135 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.compute.rpcapi [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 29 03:44:36.809588 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] Releasing lock "compute-rpcapi-router" {{(pid=123254) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 29 03:44:36.852600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dde289d3-61b4-4425-aa1d-21a1405341df None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347073 Jan 29 03:44:36.856841 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:36.869222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1163976518", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:36.988853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] validate_networks() for [('def124bd-d2cb-4303-acf8-363c1eeee992', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:37.476477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:37.496522 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2bea7cdf-6a92-4ad2-84a3-3d3df8145303 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 1.417429 Jan 29 03:44:37.510956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:36 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:37.528707 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:37.532760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:37.548945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:37.554892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:37.563170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:37.563853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:38.669891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:38.700461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2390576d-4c16-4e6f-9700-9d30739ea7d0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 1.188121 Jan 29 03:44:38.715249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 31/60] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:37 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:38.724551 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:38.725549 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:38.754308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:38.754630 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:38.755713 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:38.755860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:39.341259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:39.343239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:39.344990 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:39.345814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:39.346755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:39.361513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:39.364463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:39.367042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:39.367724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:39.464158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Getting quotas for project 995678f3901441a099ca67990ffaa293. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:39.482353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Getting quotas for user d27a0c13cce84006bd75226460140783 and project 995678f3901441a099ca67990ffaa293. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:39.531694 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:39.536796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:39.731150 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-83964a52-eb9f-4b9a-8291-e10510dd7e35 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.867686 Jan 29 03:44:39.750574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:44:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:44:39.759370 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-89dcf007-0fe7-4ab3-8ed4-ce2b545bc029 req-6557f0c6-db95-43d7-b9e8-420c5d1e5f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb51aefd-c927-464c-a843-4291d9f9ec0b", "tag": "26b58599-e1e8-4de8-a1fd-779b33246181"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:39.762630 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:39.762630 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:44:39.799465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-89dcf007-0fe7-4ab3-8ed4-ce2b545bc029 req-6557f0c6-db95-43d7-b9e8-420c5d1e5f40 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:39.799922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-89dcf007-0fe7-4ab3-8ed4-ce2b545bc029 req-6557f0c6-db95-43d7-b9e8-420c5d1e5f40 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:39.834194 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:39.845788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7a3545b4-e160-4cd6-9e8b-03cbaa7b4589 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 1.129338 Jan 29 03:44:39.852253 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 32/62] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:38 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:39.862855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:39.868703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-89dcf007-0fe7-4ab3-8ed4-ce2b545bc029 req-6557f0c6-db95-43d7-b9e8-420c5d1e5f40 service nova] Creating event network-changed:26b58599-e1e8-4de8-a1fd-779b33246181 for instance fb51aefd-c927-464c-a843-4291d9f9ec0b on hv-cinder-82694 Jan 29 03:44:39.889094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:39.894629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-89dcf007-0fe7-4ab3-8ed4-ce2b545bc029 req-6557f0c6-db95-43d7-b9e8-420c5d1e5f40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142655 Jan 29 03:44:39.906488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 31/63] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:39.911822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:39.913728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:39.914327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-74af21e0-8b72-4dd7-90da-973f57dddc57 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:39.915134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-74af21e0-8b72-4dd7-90da-973f57dddc57 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:39.915675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:39.916246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:40.186781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-74af21e0-8b72-4dd7-90da-973f57dddc57 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:40.186781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-74af21e0-8b72-4dd7-90da-973f57dddc57 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1222 microversion: 2.1 time: 0.263106 Jan 29 03:44:40.186781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:39 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:40.368092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1464153325", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204ced72-9299-4a30-aa72-466acced45bf"}], "security_groups": [{"name": "tempest-securitygroup--1114631034"}], "key_name": "tempest-keypair-407818180", "user_data": "}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:40.672265 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:40.693238 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d486de07-c71a-4edc-8255-f5b62aa33636 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.832967 Jan 29 03:44:40.694689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:39 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:40.873223 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:40.873223 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:40.883007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:40.883992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:40.885275 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:40.892889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:40.893126 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] validate_networks() for [('204ced72-9299-4a30-aa72-466acced45bf', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:42.034892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:42.049800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b207c51e-6a40-4dda-861a-0abde54a6812 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 1.184342 Jan 29 03:44:42.051326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:40 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:42.064800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:42.065762 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:42.080722 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.083788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.087268 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.087268 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.205901 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:42.215495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0f7c0828-5bf5-41c9-bbdc-031f1c17a162 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1226 microversion: 2.1 time: 0.162023 Jan 29 03:44:42.229566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 35/67] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:42 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:42.243769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:42.253502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:42.260132 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.263013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.264042 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.265521 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.327348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:42.328552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:42.328809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:42.329748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:42.330868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:42.353050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.353758 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.356731 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:42.356731 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:42.467981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:42.481404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:42.519016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:42.524464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:42.595608 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:42.609430 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ba99af06-19f3-4f39-ae87-b2f7f05332bf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.377846 Jan 29 03:44:42.610565 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 36/68] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:42 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:42.853237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-90f9fe0d-5e96-4eec-98dd-7711fe790e58 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.490906 Jan 29 03:44:42.858791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 33/69] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Jan 29 03:44:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 29 03:44:42.864995 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:42.865982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:43.029347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:43.036787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:43.052642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:43.053939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bf97ca7f-30fd-40e3-81a2-2d6d72a2622b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1281 microversion: 2.20 time: 0.193321 Jan 29 03:44:43.072865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 37/70] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:42 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1281 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:43.080808 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:43.081444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:43.093748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.094715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:43.101836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.101836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:43.232868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:43.233501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:43.252899 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.253432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:43.263377 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.270559 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:43.422399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:43.435400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:43.444148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-41b3c8e4-10ce-423b-9c29-1ab5faccb603 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.372817 Jan 29 03:44:43.455495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 34/71] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:43 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:43.470275 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4f4063af-6910-4487-a7fd-0ce4eeb5f618 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1274 microversion: 2.1 time: 0.238628 Jan 29 03:44:43.483259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:43 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:43.626953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:43.627739 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:43.638061 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.643783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:43.644857 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:43.645468 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:44.072430 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:44.073827 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:44.437242 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.453730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ca1f8127-4af9-46fa-9274-0150cdda03c2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.827165 Jan 29 03:44:44.465736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 35/73] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:43 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:44.475165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:44.475921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:44.482369 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:44.483000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:44.485339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:44.485339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:44.565308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.573378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.577501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.579214 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-59ad43c2-9f11-4235-a17b-8bd24777469a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1281 microversion: 2.20 time: 0.510610 Jan 29 03:44:44.581839 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 39/74] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:44 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1281 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:44:44.591080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:44.592726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:44.602312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:44.603720 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:44.604845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:44.619094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:44.723396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.733487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ac2b4815-b1e4-4726-85a1-4996a9191d00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1280 microversion: 2.1 time: 0.150391 Jan 29 03:44:44.735379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:44 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:44.921086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:44.952663 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5073b609-48c9-41e2-a5dd-b95828191489 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.476766 Jan 29 03:44:44.958654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 36/76] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:44 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:45.250892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1638460648", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b4e9710-b6c9-4002-b8a3-8aa9bf7336cb"}], "security_groups": [{"name": "tempest-securitygroup--1723519298"}], "key_name": "tempest-keypair-1150490258", "user_data": "}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:45.472287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:45.474036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:45.485354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.486024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:45.488027 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.488635 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:45.511557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] validate_networks() for [('4b4e9710-b6c9-4002-b8a3-8aa9bf7336cb', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:44:45.710068 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:45.723378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0d628728-87a0-4fbc-ad69-516dae31ebd9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.256062 Jan 29 03:44:45.725154 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 37/77] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:45 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:45.732356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:45.733763 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:45.744182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.745362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:45.755984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.756602 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:45.907728 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:45.921479 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:45.924049 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:45.925595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-75e75a76-ba36-421e-9d68-a02b9bfde7d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1333 microversion: 2.20 time: 0.199107 Jan 29 03:44:45.938650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 38/78] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:45 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1333 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:45.946096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:45.947319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:45.956755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.957559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:45.958662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:45.959822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.285269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:46.293209 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a47fbccb-a345-49ad-a536-bfecc2b4b685 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.352992 Jan 29 03:44:46.293796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 39/79] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:45 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:46.424457 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-0c4b3ca9-2588-4b59-a28c-f428ad1b2de9 req-2a6ca0fa-7188-4a1e-8559-76cd6a6e0319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333eec8c-4437-4fe4-9440-e0210b9b6b71", "tag": "99574264-03c0-4cb9-9094-a916433c52ab"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:46.427546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:46.427546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:44:46.436346 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-0c4b3ca9-2588-4b59-a28c-f428ad1b2de9 req-2a6ca0fa-7188-4a1e-8559-76cd6a6e0319 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.437638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-0c4b3ca9-2588-4b59-a28c-f428ad1b2de9 req-2a6ca0fa-7188-4a1e-8559-76cd6a6e0319 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.450603 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-0c4b3ca9-2588-4b59-a28c-f428ad1b2de9 req-2a6ca0fa-7188-4a1e-8559-76cd6a6e0319 service nova] Creating event network-changed:99574264-03c0-4cb9-9094-a916433c52ab for instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 on hv-cinder-82694 Jan 29 03:44:46.456957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-0c4b3ca9-2588-4b59-a28c-f428ad1b2de9 req-2a6ca0fa-7188-4a1e-8559-76cd6a6e0319 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152988 Jan 29 03:44:46.458303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 40/80] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:46.459621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:44:46.460064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:44:46.460502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:44:46.460911 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:44:46.461322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:44:46.464655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:46.465699 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:46.473700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.474907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.475928 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.476499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.477888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.478412 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.479294 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.479760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.545596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:44:46.549985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:44:46.563319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:44:46.570751 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:44:46.737434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5c4058d2-db1f-425c-82e2-d8dc8769ba4b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.491415 Jan 29 03:44:46.742510 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 41/81] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:44:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:44:46.794773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:46.795725 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:46.805709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.806434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.820561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:46.821854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:46.926908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:46.938288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-622142f4-8170-423a-be0f-443a0201de01 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.476820 Jan 29 03:44:46.940282 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:46 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:46.947375 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-88d940ec-3d0f-4f31-8c7f-9e02d65c1faf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:46.951843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-88d940ec-3d0f-4f31-8c7f-9e02d65c1faf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:47.151143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.169237 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a2aab54f-161b-4ffb-9dde-e30080c362ae tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.412023 Jan 29 03:44:47.170349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-88d940ec-3d0f-4f31-8c7f-9e02d65c1faf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.170824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:46 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:47.177400 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:47.178094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-88d940ec-3d0f-4f31-8c7f-9e02d65c1faf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1238 microversion: 2.1 time: 0.236736 Jan 29 03:44:47.178525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:47.180618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 42/84] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:46 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1238 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:47.199009 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.199664 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.202007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.208267 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.217199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-940f02c7-b744-4e4c-bd9f-974135594d92 req-3deb0fcc-e7bd-474d-8ee8-d0bf2247ad3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5ee017-4daf-4262-8ab0-d31cbfc42bce", "tag": "5e8c426e-0aed-4140-8239-4f445cd530d4"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:47.219334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:47.219334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:44:47.242663 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-940f02c7-b744-4e4c-bd9f-974135594d92 req-3deb0fcc-e7bd-474d-8ee8-d0bf2247ad3e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.246617 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-940f02c7-b744-4e4c-bd9f-974135594d92 req-3deb0fcc-e7bd-474d-8ee8-d0bf2247ad3e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.268714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-940f02c7-b744-4e4c-bd9f-974135594d92 req-3deb0fcc-e7bd-474d-8ee8-d0bf2247ad3e service nova] Creating event network-changed:5e8c426e-0aed-4140-8239-4f445cd530d4 for instance ce5ee017-4daf-4262-8ab0-d31cbfc42bce on hv-cinder-82694 Jan 29 03:44:47.279049 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-940f02c7-b744-4e4c-bd9f-974135594d92 req-3deb0fcc-e7bd-474d-8ee8-d0bf2247ad3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066668 Jan 29 03:44:47.282537 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 43/85] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:47.310736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:47.311716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:47.319715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.320458 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.321264 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.321684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.412997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.423803 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.425658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.427032 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8733cbae-61f1-47d9-9f6e-a17f37000ca6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1339 microversion: 2.20 time: 0.255218 Jan 29 03:44:47.427926 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 43/86] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:47 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1339 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:47.746604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:47.756731 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1756d871-ad73-4d2c-a0fe-a80a47013499 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.448868 Jan 29 03:44:47.765942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 44/87] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:47 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:47.956285 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:47.958007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:47.970396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.970926 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:47.971765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:47.972198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.192361 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:48.193482 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:48.201961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.204780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.206463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.209726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.351547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.361273 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-38879159-7ac2-4974-9cc6-080c6c265b74 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.407274 Jan 29 03:44:48.362385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:47 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:48.367372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-01ad71c6-8d11-4e62-bfd0-50176da11ea5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:48.368284 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-01ad71c6-8d11-4e62-bfd0-50176da11ea5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:48.443695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-01ad71c6-8d11-4e62-bfd0-50176da11ea5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.451016 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-01ad71c6-8d11-4e62-bfd0-50176da11ea5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1238 microversion: 2.1 time: 0.087406 Jan 29 03:44:48.451594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 45/89] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:48 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:48.457453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:48.457994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:48.466346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.467105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.468167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.469327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.540815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.549183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.551100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.552234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a32fd8b0-05e8-4bef-97ca-a89f1c3535b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1339 microversion: 2.20 time: 0.099514 Jan 29 03:44:48.552792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 46/90] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:48 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:48.678997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.690224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a27e45cf-7a7d-432c-906d-ec0abd9d7240 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.501839 Jan 29 03:44:48.695356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 45/91] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:48 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:48.774473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:48.775173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:48.781052 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.781564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.782442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:48.782947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:48.933523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:48.933523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b4a7e1ef-a7a3-4f7c-89ca-a6399929b4ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.161841 Jan 29 03:44:48.933523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:48 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:49.379422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:49.380028 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:49.385974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.386453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.387211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.387639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.468515 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:49.474729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:49.475859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.475859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.476605 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.476892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.594432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:49.602634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1a757a57-9e9e-42d6-8858-0b2ec42b9513 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1242 microversion: 2.1 time: 0.137843 Jan 29 03:44:49.613470 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 48/93] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:49 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:49.618586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:49.619398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:49.641501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.642276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.644427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.647750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.669506 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:49.680031 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-08e94a7a-d0b6-44fd-bf49-136cb50cfcde tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.304207 Jan 29 03:44:49.684229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 46/94] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:49 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:49.708778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:49.710193 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:49.722050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.722556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.724062 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.724513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.931297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:49.938086 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:49.944892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:49.946257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-97be4fe6-d615-43e6-84b9-5b21d9bad2cd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.331359 Jan 29 03:44:49.947809 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 49/95] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:49 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:49.956358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:49.957495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:49.982593 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.984484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:49.985338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:49.987269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.228412 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:50.246568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-397293e0-83aa-4963-876a-f56823b972d1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.291637 Jan 29 03:44:50.246568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 50/96] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:49 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:50.263107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:50.273319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-13d1bbb2-d9bd-42fd-8f42-ef73e2c53f9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.569092 Jan 29 03:44:50.279549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 47/97] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:49 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:50.628854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:50.628854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:50.635643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.636869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.638235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.638887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.702548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:50.709971 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:50.726915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.727710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.728693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.729319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.775880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:50.786178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1f398d38-8226-4a65-8090-7066cf2f29a6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1290 microversion: 2.1 time: 0.169156 Jan 29 03:44:50.786765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 51/98] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:50 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:50.969331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:50.971496 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:50.984431 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.985263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:50.988263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:50.989880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.128693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.141707 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a27cba2d-b5bc-4f70-a7c4-cb7024295712 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.443534 Jan 29 03:44:51.144915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:50 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:51.188852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-af0ca96f-c700-4f30-9ff5-94b79bf4dd97 req-8c323e6c-b97f-4e98-a6a4-4803b3410bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:51.193611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:51.193611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:44:51.209935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-af0ca96f-c700-4f30-9ff5-94b79bf4dd97 req-8c323e6c-b97f-4e98-a6a4-4803b3410bc4 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.210460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-af0ca96f-c700-4f30-9ff5-94b79bf4dd97 req-8c323e6c-b97f-4e98-a6a4-4803b3410bc4 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.274355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-af0ca96f-c700-4f30-9ff5-94b79bf4dd97 req-8c323e6c-b97f-4e98-a6a4-4803b3410bc4 service nova] Creating event network-changed:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:44:51.282981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-af0ca96f-c700-4f30-9ff5-94b79bf4dd97 req-8c323e6c-b97f-4e98-a6a4-4803b3410bc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111771 Jan 29 03:44:51.284296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 49/100] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:51.289804 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:51.313021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:51.327116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.328104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.328913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.329347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.330252 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.365444 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.372589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.379334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ee9a9e81-27ee-46a8-b2e8-65e68155cca2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.410241 Jan 29 03:44:51.380004 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 52/101] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:50 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:44:51.405976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:51.406649 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:51.445979 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.446614 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.448793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.449404 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.668504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.677947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-560c6990-a080-416a-b199-404cccd03fb9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.296635 Jan 29 03:44:51.678907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:51 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:51.803779 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:51.804665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:51.813360 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.815889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.816973 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:51.818724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:51.835505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.847566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3b56c05a-91af-4509-8607-5092098d0184 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.561805 Jan 29 03:44:51.850733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 50/103] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:51 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:51.936643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:51.946950 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3e6e60dc-966c-43a0-ad43-26f73742ed9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1296 microversion: 2.1 time: 0.146841 Jan 29 03:44:51.948006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 54/104] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:51 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:52.162431 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:52.163798 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:52.170859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.171428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.172405 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.172981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.397163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:52.398033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:52.403886 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.404394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.409805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.410281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.549179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:52.556411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-333e0494-7e6e-434f-ab79-6b73b56492f7 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.398338 Jan 29 03:44:52.557630 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:52 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:52.649598 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:52.658795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:52.661285 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:52.666432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f3422955-d454-4e95-8836-ffb3c6722edb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.268532 Jan 29 03:44:52.672721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 55/106] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:52 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:52.694736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:52.695464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:52.701485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.702005 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.702917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.703417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.866523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:52.872449 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:52.886784 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.887335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:52.892014 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:52.892650 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.053340 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:53.062421 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bdc9a7ba-36f2-4bec-b10a-ad81d568e2c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.371042 Jan 29 03:44:53.063533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 52/107] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:52 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:53.072761 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:53.072761 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:53.076142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.076816 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.078052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.078669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.107435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:53.127568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-244212ab-61e4-4636-b65c-a9d8beb8933a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.264799 Jan 29 03:44:53.128158 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:52 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:53.501622 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:53.509793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6910b873-b243-44ba-8e7c-0959af3851f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.444812 Jan 29 03:44:53.510411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:53 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:53.574426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:53.575030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:53.582678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.583136 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.583916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.584347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.680129 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:53.681032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:53.689635 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.690493 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.697473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:53.698210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:53.806447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:53.817219 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6f9cc87a-7e9d-46f7-90f0-eaa99c122ab5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.247192 Jan 29 03:44:53.819256 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:53 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:54.004295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.012717 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.014423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.015706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-42631999-085f-4a1b-9a4e-6109607646f8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.339382 Jan 29 03:44:54.016692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 54/111] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:53 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:44:54.082323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:54.082323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:54.090907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.092068 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.093665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.094860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.145163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:54.145858 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:54.162100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.163271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.165189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.173383 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.297059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.304337 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3c302340-1c0b-4f7f-9627-1c5dccbe2913 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.229012 Jan 29 03:44:54.304904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 58/112] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:54 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:54.346941 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-7eb07dbb-b00a-49b2-9bd8-999e453603ad req-d3471780-ac65-42c2-993c-8ab58729f74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fc5079-1458-479d-b5b0-d0b0fb1e9235", "tag": "b515e1c3-80c1-45a6-ac70-b260f4d4c858"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:54.349622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:54.349622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:44:54.360349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-7eb07dbb-b00a-49b2-9bd8-999e453603ad req-d3471780-ac65-42c2-993c-8ab58729f74a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.361019 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-7eb07dbb-b00a-49b2-9bd8-999e453603ad req-d3471780-ac65-42c2-993c-8ab58729f74a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.394394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-7eb07dbb-b00a-49b2-9bd8-999e453603ad req-d3471780-ac65-42c2-993c-8ab58729f74a service nova] Creating event network-changed:b515e1c3-80c1-45a6-ac70-b260f4d4c858 for instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 on hv-cinder-82694 Jan 29 03:44:54.394394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-7eb07dbb-b00a-49b2-9bd8-999e453603ad req-d3471780-ac65-42c2-993c-8ab58729f74a service nova] Acquired lock "compute-rpcapi-router" {{(pid=123253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 29 03:44:54.394394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.394394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.394394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.394822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.394822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.compute.rpcapi [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 29 03:44:54.394965 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] Releasing lock "compute-rpcapi-router" {{(pid=123253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 29 03:44:54.421035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d77f3075-856e-426d-b323-f5799fb68e70 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078324 Jan 29 03:44:54.422115 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 59/113] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:54.436513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.445521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a9d057f2-124e-44e1-b06a-8bb8c53c641d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.303867 Jan 29 03:44:54.446103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 55/114] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:54 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:54.527340 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:54.528038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:54.534019 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.534498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.543010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.543010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.675380 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:54.682832 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0d4a2f97-9dee-49a6-8f21-aea5d84077aa tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.159459 Jan 29 03:44:54.683390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 60/115] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:54 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:54.835270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:54.835874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:54.841559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.842018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.842818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:54.843316 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:54.995669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.005767 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c8edc8b9-be85-4e34-8c23-63b19d1811dc tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.174273 Jan 29 03:44:55.014683 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 56/116] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:54 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:55.034091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:55.034722 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:55.040726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.041168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.041936 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.042389 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.176063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.184184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.185880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.187567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-976df887-450c-4903-be15-71308a0a714a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.156894 Jan 29 03:44:55.188271 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 61/117] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:55 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:55.320524 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:55.321133 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:55.326859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.327301 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.328101 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.331475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.470539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:55.473807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:55.484601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.490426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.491525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.492131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.532528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.542807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2e8c9388-83ea-4776-bed0-e28dfff3d942 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.225899 Jan 29 03:44:55.554699 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 57/118] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:55 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:55.700778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:55.701462 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:55.710935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.711759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.713190 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:55.713984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:55.737712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.744939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8bfdac86-79d6-4a0a-a00a-dd868d6b6033 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.283894 Jan 29 03:44:55.745689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 62/119] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:55 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:55.900336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:55.908016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-47ab09a3-9e72-4232-92d9-587145d007bd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.211442 Jan 29 03:44:55.914322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 58/120] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:55 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:56.022018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:56.023057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:56.035623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.035623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.035623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.035623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.207228 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:56.208359 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:56.210057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:56.215943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.216388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.217427 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.217978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.226891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c8b5b4eb-90d1-4b68-91e6-0adf736e48f3 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.208195 Jan 29 03:44:56.228794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 63/121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:56 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:56.441863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-b0745dae-6ea0-4894-b86e-94e434a1fb9c req-f0e836bc-ada5-43c4-ab96-f59a1f05e413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333eec8c-4437-4fe4-9440-e0210b9b6b71", "name": "network-vif-plugged", "status": "completed", "tag": "99574264-03c0-4cb9-9094-a916433c52ab"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:56.443728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:56.443728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:44:56.450740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-b0745dae-6ea0-4894-b86e-94e434a1fb9c req-f0e836bc-ada5-43c4-ab96-f59a1f05e413 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.451417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-b0745dae-6ea0-4894-b86e-94e434a1fb9c req-f0e836bc-ada5-43c4-ab96-f59a1f05e413 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.465246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-b0745dae-6ea0-4894-b86e-94e434a1fb9c req-f0e836bc-ada5-43c4-ab96-f59a1f05e413 service nova] Creating event network-vif-plugged:99574264-03c0-4cb9-9094-a916433c52ab for instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 on hv-cinder-82694 Jan 29 03:44:56.473425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:56.476743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-b0745dae-6ea0-4894-b86e-94e434a1fb9c req-f0e836bc-ada5-43c4-ab96-f59a1f05e413 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105328 Jan 29 03:44:56.479185 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 64/122] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:56.485914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:56.487528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:56.488645 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e4bfe225-c05e-4e42-8338-4154b2185f97 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.287275 Jan 29 03:44:56.489197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 59/123] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:56 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:44:56.567007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:56.567972 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:56.576266 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.576894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.577807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.578276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.762062 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:56.763102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:56.775225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.775905 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.776937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.777585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.799561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:56.814440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8b116820-701a-4bc9-ac57-429cf3877958 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.252073 Jan 29 03:44:56.816358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 65/124] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:56 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:56.924938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:56.925550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:56.932086 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.932585 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:56.933384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:56.933853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.350743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.360765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6a27f39d-334f-4e2e-8131-5afd7b485e36 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.439648 Jan 29 03:44:57.362364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 66/125] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:56 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:57.367325 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:57.368130 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:57.376811 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.378028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.379007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.379779 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.445350 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.456234 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2779fc8c-5ba7-43b1-ad31-ffd7823b0755 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.697778 Jan 29 03:44:57.457486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:56 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:57.506465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:57.507792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:57.513518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.514031 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.514934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.515390 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.797105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.805861 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.807817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.809152 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-64738fdb-ff4e-4cc1-94c9-e758c79ea2e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.306494 Jan 29 03:44:57.821464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 61/127] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:57 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:44:57.831572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:57.832649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:57.840548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.841842 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.843617 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:57.844381 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:57.986223 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:57.993374 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e57fc9e4-78aa-4903-9fcf-4564e00221df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.630017 Jan 29 03:44:57.993948 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:57 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:58.028225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:58.034336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6e5e1f31-46c8-48b2-84e0-e6da8a2e9d87 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.206944 Jan 29 03:44:58.035039 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 62/129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:57 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:58.377212 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:58.377818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:58.383667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.384112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.384874 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.385298 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.473403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:58.474461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:58.481620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.482473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.483697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.484992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.534992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:58.542538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ca4bd90a-3a3d-4596-8bb7-dc407d8c5249 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.168972 Jan 29 03:44:58.552657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 68/130] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:58 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:58.552657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb51aefd-c927-464c-a843-4291d9f9ec0b", "name": "network-vif-plugged", "status": "completed", "tag": "26b58599-e1e8-4de8-a1fd-779b33246181"}, {"server_uuid": "d0238dfa-64ff-4122-8f56-0f4430b66bbb", "name": "network-vif-plugged", "status": "completed", "tag": "344261af-89bd-4849-88f4-09b55da6299e"}, {"server_uuid": "ce5ee017-4daf-4262-8ab0-d31cbfc42bce", "name": "network-vif-plugged", "status": "completed", "tag": "5e8c426e-0aed-4140-8239-4f445cd530d4"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:44:58.552657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:44:58.552657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:44:58.567220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.567967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.586446 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Creating event network-vif-plugged:26b58599-e1e8-4de8-a1fd-779b33246181 for instance fb51aefd-c927-464c-a843-4291d9f9ec0b on hv-cinder-82694 Jan 29 03:44:58.587991 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Creating event network-vif-plugged:344261af-89bd-4849-88f4-09b55da6299e for instance d0238dfa-64ff-4122-8f56-0f4430b66bbb on hv-cinder-82694 Jan 29 03:44:58.589231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] Creating event network-vif-plugged:5e8c426e-0aed-4140-8239-4f445cd530d4 for instance ce5ee017-4daf-4262-8ab0-d31cbfc42bce on hv-cinder-82694 Jan 29 03:44:58.599868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-80fd46d0-5655-4138-bc34-c461e9ed0592 req-76ed2b3e-484b-41bd-8c5e-12f99bfdc46b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054853 Jan 29 03:44:58.601982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 69/131] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:44:58.830509 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:58.831207 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:58.837525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.837983 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.838922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:58.839363 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:58.927752 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:58.935898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f6c060ed-8c1b-4c4c-83d8-37a8f07da1e4 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.466240 Jan 29 03:44:58.946745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 63/132] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:58 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:58.993651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.004800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.004800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.004800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-340a0629-aa67-44e6-904d-c5bcb44e88a8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.179886 Jan 29 03:44:59.006933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 70/133] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:44:58 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:44:59.010271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:59.010883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:59.020988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.021440 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.022535 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.022973 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.050710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:59.052189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:59.064222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.064222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.064222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.066104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.184142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.191889 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-05c1b0d7-971e-4ac6-b4cd-e9cbc4e42f9d tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.185291 Jan 29 03:44:59.192489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 64/134] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:59 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:44:59.213637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.221319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ebf49a93-91cd-4675-a832-4939b4c18db7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.174068 Jan 29 03:44:59.221835 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:59 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:59.560454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:59.561069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:59.567650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.568240 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.569026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.569631 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.737144 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:44:59.744594 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a896ba9f-917b-4984-92ab-ed05618239a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.188200 Jan 29 03:44:59.745148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 65/136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:59 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:44:59.954451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:44:59.955146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:44:59.961222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.961661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:44:59.962445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:44:59.962914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.025254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:00.025851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:00.033289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.033923 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.034890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.035539 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.122639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.134721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-745ff65d-34e5-4901-a4bc-b38b8778fbfe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.181332 Jan 29 03:45:00.135567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 72/137] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:44:59 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:00.191575 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.200367 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.204073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.205593 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-977c34bf-0c0a-4ef0-b457-eaa6e79af64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.184517 Jan 29 03:45:00.206469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 66/138] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:00 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:00.209272 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:00.209910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:00.215909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.216569 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.217356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.217815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.240419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:00.241029 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:00.247668 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.248116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.248898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.249388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.373573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.382806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-39e967d4-87c1-406b-b767-26c55b49b64c tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.177411 Jan 29 03:45:00.383710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:00 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:00.403254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.410982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0df71236-e249-4b2a-81ed-7a05866d2d01 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.174136 Jan 29 03:45:00.411755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 67/140] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:00 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:00.761791 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:00.763571 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:00.768919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.769362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.770155 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:00.770598 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:00.907930 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:00.918067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e0ce182-d8d9-466f-aed7-8877570c574b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.159759 Jan 29 03:45:00.918880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 74/141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:00 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:01.152782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:01.153418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:01.159244 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.159689 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.160455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.160888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.223383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:01.223975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:01.229884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.230352 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.231341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.231693 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.302682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.306414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-562f399e-424f-4354-8607-b05da2ac616b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.157393 Jan 29 03:45:01.307140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 68/142] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:01 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:01.401742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:01.402701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:01.418290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.418290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.418290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.418290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.421364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.432660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.434578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.435939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-36d54236-5bc4-4938-8233-da8b6bba82fd tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.216295 Jan 29 03:45:01.437421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 75/143] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:01 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:01.462606 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:01.463279 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:01.489246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.492077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.493092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.495701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.705083 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.714463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8a208680-6755-4ce2-a474-3802a7028449 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.317326 Jan 29 03:45:01.715762 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 69/144] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:01 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:01.726164 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:01.733895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4bf449bc-4681-4523-b455-2d45f4c8600c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.295250 Jan 29 03:45:01.734508 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 76/145] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:01 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:01.936770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:01.937484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:01.954479 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.957343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:01.961802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:01.961802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.229726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.237268 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6914c36d-babe-4921-8fd8-5f844c3d1d12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.305016 Jan 29 03:45:02.237844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 70/146] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:01 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:02.323567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:02.324254 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:02.330872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.336689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.337784 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.338258 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.455734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:02.456472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:02.466926 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.472139 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.478189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.478911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.503615 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.513763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b4f2b8a3-a324-4a14-9f2a-4972439242ae tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.193796 Jan 29 03:45:02.514459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 77/147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:02 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:02.642901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.653056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.654595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.655753 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4186da18-3b9a-4f58-ad87-9b3bfd0fa01a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.204095 Jan 29 03:45:02.656304 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 71/148] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:02 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:02.732220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:02.732862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:02.739384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.739858 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.740621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.741084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.750569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:02.751262 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:02.757116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.757635 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.758529 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:02.759040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:02.914913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.915973 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:02.923003 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f734ff26-ac8a-42fa-b178-84561978967a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.176650 Jan 29 03:45:02.923570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 72/149] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:02 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:02.924450 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fe4e0e29-0bda-4315-86ec-2c0b57c17216 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.196039 Jan 29 03:45:02.925169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:02 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:03.258630 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:03.259246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:03.265573 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.266022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.266827 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.267259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.406287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:03.413565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d10e5f12-2158-4fbd-a212-845fb54acb6f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.163131 Jan 29 03:45:03.414056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 73/151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:03 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:03.531213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:03.531976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:03.537774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.538268 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.539049 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.539485 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.673956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:03.674942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:03.681379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:03.681820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.682503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.683831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.684474 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.692595 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bc6a7b53-3c0b-4a1f-ab2a-8ac953a15fb7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.165021 Jan 29 03:45:03.707977 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 79/152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:03 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:03.839360 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:03.847511 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:03.849243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:03.850571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-95d15c3e-45bb-44d5-893b-dc4af1dbdcb6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.180230 Jan 29 03:45:03.851309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 74/153] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:03 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:03.875849 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-ba49a4ae-ff77-4995-8beb-d5311480bf67 req-0328a88a-63dc-4e4b-a546-771b9fbec4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "name": "network-vif-plugged", "status": "completed", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:03.877818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:03.877818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:45:03.887336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-ba49a4ae-ff77-4995-8beb-d5311480bf67 req-0328a88a-63dc-4e4b-a546-771b9fbec4a8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.900830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-ba49a4ae-ff77-4995-8beb-d5311480bf67 req-0328a88a-63dc-4e4b-a546-771b9fbec4a8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.900830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-ba49a4ae-ff77-4995-8beb-d5311480bf67 req-0328a88a-63dc-4e4b-a546-771b9fbec4a8 service nova] Creating event network-vif-plugged:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:45:03.906454 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-ba49a4ae-ff77-4995-8beb-d5311480bf67 req-0328a88a-63dc-4e4b-a546-771b9fbec4a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037105 Jan 29 03:45:03.907056 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 80/154] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:03.944441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:03.945455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:03.946735 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:03.947472 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:03.952622 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.953266 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.954246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.954837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.955457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.956626 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:03.957637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:03.958061 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.135414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:04.147422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-361682e8-8fcf-49ee-808b-18405a9c04c4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1315 microversion: 2.1 time: 0.204623 Jan 29 03:45:04.153342 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 81/155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:03 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:04.177036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:04.185283 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-012a3af3-1b2a-4a79-9ffa-b8785558108b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1317 microversion: 2.1 time: 0.244436 Jan 29 03:45:04.185933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 75/156] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:03 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:04.431011 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:04.431759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:04.438329 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.438899 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.439791 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.440327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.667856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:04.677083 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-75d9fb2a-11dd-4870-8f3f-d10be172acf8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.250590 Jan 29 03:45:04.678171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 82/157] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:04 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:04.711615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:04.712975 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:04.720275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.721552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.722417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.722849 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.860638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:04.868197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:04.868668 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-be61ae99-5447-4826-a7c3-b0e8489ba524 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1322 microversion: 2.1 time: 0.160976 Jan 29 03:45:04.868819 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:04.869270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 76/158] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:04 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:04.875542 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.875986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:04.876815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:04.877220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.014058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.027527 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.029038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.030683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a15787ec-ede7-4a20-9013-d851453b1862 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.166278 Jan 29 03:45:05.031236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 83/159] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:04 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:05.169708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:05.170371 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:05.176657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.177099 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.177860 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.178330 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.201584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:05.202237 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:05.210436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.212894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.212894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.212894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.335446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.343951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-add42950-2793-45b3-93f9-a05ab435a4f4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1502 microversion: 2.1 time: 0.177816 Jan 29 03:45:05.356015 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 77/160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:05 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:05.360985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.370281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9cad9416-1076-4cdd-9d46-1118adcaf70a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1507 microversion: 2.1 time: 0.171994 Jan 29 03:45:05.382276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 84/161] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:05 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:05.694471 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:05.695069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:05.701090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.701437 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.702237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.702673 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.835433 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:05.843451 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d5b147e0-bee3-4c9a-99d8-b5a70e388722 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.152005 Jan 29 03:45:05.844103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 78/162] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:05 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:05.888957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:05.890661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:05.900165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.901737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.902920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.903739 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.927244 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-77ebbc97-f22a-4894-bf9c-bdcb1c8904f6 req-7feaf8e6-1ffa-4a4c-be1f-61f6d8650a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fc5079-1458-479d-b5b0-d0b0fb1e9235", "name": "network-vif-plugged", "status": "completed", "tag": "b515e1c3-80c1-45a6-ac70-b260f4d4c858"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:05.929035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:05.929035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:05.935865 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-77ebbc97-f22a-4894-bf9c-bdcb1c8904f6 req-7feaf8e6-1ffa-4a4c-be1f-61f6d8650a2b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:05.936376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-77ebbc97-f22a-4894-bf9c-bdcb1c8904f6 req-7feaf8e6-1ffa-4a4c-be1f-61f6d8650a2b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:05.947698 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-77ebbc97-f22a-4894-bf9c-bdcb1c8904f6 req-7feaf8e6-1ffa-4a4c-be1f-61f6d8650a2b service nova] Creating event network-vif-plugged:b515e1c3-80c1-45a6-ac70-b260f4d4c858 for instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 on hv-cinder-82694 Jan 29 03:45:05.956269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-77ebbc97-f22a-4894-bf9c-bdcb1c8904f6 req-7feaf8e6-1ffa-4a4c-be1f-61f6d8650a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Jan 29 03:45:05.957185 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 79/163] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:45:06.049414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:06.050100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:06.056350 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.056716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.057645 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.058258 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.087001 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:06.098566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-458690b6-071b-4f4f-8b0c-f3b29b2bf805 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1515 microversion: 2.1 time: 0.215890 Jan 29 03:45:06.101396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 85/164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:05 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:06.118598 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:06.119772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:06.126601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.127168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.128406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.128907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.194588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'flavor' on Instance uuid ce5ee017-4daf-4262-8ab0-d31cbfc42bce {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:45:06.341555 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:06.350051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:06.351643 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:06.352740 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3a818f4c-7c7b-46eb-9327-962837e2fcc1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.307922 Jan 29 03:45:06.353335 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 80/165] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:06 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:06.725427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5207b3fb-95e5-4b81-9649-6098d6e32600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce/action" status: 200 len: 32 microversion: 2.1 time: 0.610408 Jan 29 03:45:06.726033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 86/166] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:45:06 2022] POST /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce/action => generated 32 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:45:06.735335 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:06.735977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:06.741656 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.742096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.742883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.743307 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.866698 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:06.867573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:06.876778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:06.884101 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b86802a1-85a0-4cf8-a14f-89a6487f5e80 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.153027 Jan 29 03:45:06.884974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 81/167] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:06 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:06.911468 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.911955 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:06.912775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:06.913463 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:07.063818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:07.071298 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-817575af-98ee-47b8-969a-eed820e2bd0d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.209077 Jan 29 03:45:07.071865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 87/168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:06 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:07.370496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:07.371096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:07.376874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:07.377379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:07.378085 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:07.378650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:07.519108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:07.527171 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:07.528650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:07.529734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0ab8b260-29b6-4950-a8aa-5b26c0381fdc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.163044 Jan 29 03:45:07.530834 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 82/169] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:07 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:07.901692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:07.902409 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:07.908561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:07.909010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:07.909787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:07.914182 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:08.070324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:08.079084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-37983931-dfee-4045-9c0f-fee022014c46 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.181151 Jan 29 03:45:08.079661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 88/170] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:07 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:08.088828 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:08.088828 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:08.096151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:08.096611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:08.097397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:08.097831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:08.270455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:08.278312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4e241d97-4817-4c96-82b0-9582b2ff6f7a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.193746 Jan 29 03:45:08.279063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 83/171] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:08 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:08.548657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:08.549328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:08.555737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:08.556289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:08.557126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:08.557558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:08.711359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:08.721188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:08.723676 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:08.725464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-75abdb05-4338-4acf-8ab4-1a4ce8a86d84 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.181204 Jan 29 03:45:08.726367 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 89/172] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:08 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:09.096737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:09.097296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:09.102957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.103435 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.104198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.104631 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.296513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:09.297226 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:09.306457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.306995 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.308054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.308680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.487613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:09.496054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-345f48d6-7a62-43a5-9123-654da055758f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.403453 Jan 29 03:45:09.496701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 84/173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:09 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:09.502175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "562414ee-1787-4f18-b7e4-368e90b72ea8"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:09.503424 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:09.506726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:09.510915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.511307 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.512079 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.512503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.517031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-74d92796-d2be-4747-99a9-f1e11c063246 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.223982 Jan 29 03:45:09.519302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 90/174] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:09 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:09.745890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:09.754539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:09.761503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.762224 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.764110 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:09.765224 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:09.908070 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:09.915844 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:09.917328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:09.918453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3870ccc3-1147-420a-8fbd-da3471caf88b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1407 microversion: 2.20 time: 0.177866 Jan 29 03:45:09.919015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 91/175] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:09 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:10.414730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d91aaf-a241-4239-9926-930cadf43018"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:10.415946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:10.422435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.422961 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:10.423775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.424264 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:10.753318 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e2fb4aea-7f72-4fa5-ae85-1d93ec35ab12 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.255171 Jan 29 03:45:10.754159 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 85/176] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:45:09 2022] POST /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 194 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:10.759470 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:10.760167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:10.768145 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.768677 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:10.769475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.769912 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:10.934382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:10.942652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e17338be-66e4-4999-afa2-602673bcc976 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.187243 Jan 29 03:45:10.943520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:10 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:10.947826 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:10.948411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:10.954088 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.954558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:10.955321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:10.955742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.120406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:11.128819 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-04145513-970b-493c-9cfa-21bab7e0da94 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1364 microversion: 2.1 time: 0.184125 Jan 29 03:45:11.129313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 87/178] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:10 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:11.134002 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:11.134693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:11.140506 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.141022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.141962 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.142597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.285901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:11.300808 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:11.302653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:11.303803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-35d345fc-5110-450e-9ff9-695925fd764a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1599 microversion: 2.20 time: 0.173159 Jan 29 03:45:11.304392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 88/179] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:11 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:11.328830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:11.329312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:11.335185 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.336851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.337685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.338158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.426610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-796874fb-47a4-4af8-a416-83479e336569 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101416 Jan 29 03:45:11.427739 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 89/180] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Jan 29 03:45:11 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 29 03:45:11.721015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d0d7ae61-ea29-4d92-9823-d5e5e1a12f08 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "POST /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.309794 Jan 29 03:45:11.721748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 92/181] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:45:10 2022] POST /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:45:11.959206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:11.959934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:11.966553 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.967006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:11.968043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:11.968552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:12.114179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:12.124917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7deea710-5a9b-4977-b5b8-1311b32af220 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.169701 Jan 29 03:45:12.125498 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:11 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:12.146154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:12.153651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:12.161583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:12.162358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:12.163535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:12.163975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:12.525999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:12.534169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-29acde7f-bb20-4c33-9d35-db28b21e2467 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1549 microversion: 2.1 time: 0.392989 Jan 29 03:45:12.534759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 93/183] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:12 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1549 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:12.551579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:12.552123 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:12.557978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:12.558466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:12.559722 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:12.560002 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:12.660140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a4cf42a6-93b5-45f0-ae20-105e5110fc85 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111370 Jan 29 03:45:12.661982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 91/184] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Jan 29 03:45:12 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:13.074399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:13.080326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:13.080490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-da6d6091-54ef-4ef6-8b17-d9c60d986c11 req-15b3661a-3758-4931-bf37-4ca1fcbb82c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:13.080490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:13.080490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:13.088580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:13.089038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:13.089840 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:13.093289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:13.099940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-da6d6091-54ef-4ef6-8b17-d9c60d986c11 req-15b3661a-3758-4931-bf37-4ca1fcbb82c6 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:13.100381 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-da6d6091-54ef-4ef6-8b17-d9c60d986c11 req-15b3661a-3758-4931-bf37-4ca1fcbb82c6 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:13.115853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-da6d6091-54ef-4ef6-8b17-d9c60d986c11 req-15b3661a-3758-4931-bf37-4ca1fcbb82c6 service nova] Creating event network-changed:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:45:13.130558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-da6d6091-54ef-4ef6-8b17-d9c60d986c11 req-15b3661a-3758-4931-bf37-4ca1fcbb82c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055553 Jan 29 03:45:13.131597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 92/185] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:13.141678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:13.148692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:13.159541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:13.159981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:13.160826 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:13.161253 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:13.338495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:13.348066 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:13.349554 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:13.350729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c66eb095-a3cf-42d3-a272-abc926fb8c5f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1599 microversion: 2.20 time: 0.281672 Jan 29 03:45:13.351669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 94/186] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:13 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1599 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:13.533277 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:13.541824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-40299225-4fb1-4482-a727-2e8300673390 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.403917 Jan 29 03:45:13.542515 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 93/187] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:13 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:14.345081 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:14.345830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:14.350359 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-7a806622-cbfc-4e9b-bdff-84e8baad0a98 req-21543a4e-bfd4-45e1-9a34-b643c548807e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fc5079-1458-479d-b5b0-d0b0fb1e9235", "tag": "b515e1c3-80c1-45a6-ac70-b260f4d4c858"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:14.352470 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:14.352470 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:14.358576 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.359230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.360158 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.360692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.365273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-7a806622-cbfc-4e9b-bdff-84e8baad0a98 req-21543a4e-bfd4-45e1-9a34-b643c548807e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.365961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-7a806622-cbfc-4e9b-bdff-84e8baad0a98 req-21543a4e-bfd4-45e1-9a34-b643c548807e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.379469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-7a806622-cbfc-4e9b-bdff-84e8baad0a98 req-21543a4e-bfd4-45e1-9a34-b643c548807e service nova] Creating event network-changed:b515e1c3-80c1-45a6-ac70-b260f4d4c858 for instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 on hv-cinder-82694 Jan 29 03:45:14.387513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-7a806622-cbfc-4e9b-bdff-84e8baad0a98 req-21543a4e-bfd4-45e1-9a34-b643c548807e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041402 Jan 29 03:45:14.389929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 94/188] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:14.398046 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:14.398801 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:14.409932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.410432 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.411290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.412093 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.616047 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:14.625248 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:14.627343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:14.628920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-77d05722-d9e5-4f17-af04-002dbb713543 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1599 microversion: 2.20 time: 0.236726 Jan 29 03:45:14.630562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 95/189] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:14 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:14.637493 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:14.638462 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:14.661512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.661958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.662847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:14.663269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:14.720938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:14.753549 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-642595b5-bde9-4835-b60d-69a65710f423 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1549 microversion: 2.1 time: 0.403422 Jan 29 03:45:14.754291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:14 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1549 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:14.844995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:14.852494 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-594aae26-b431-4168-8987-ee0d386bc882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.220538 Jan 29 03:45:14.854164 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:14 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:15.650553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:15.651972 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:15.658895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.660347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.661348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.661832 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.772183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:15.772792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:15.778992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.779435 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.780737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.781177 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.804223 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:15.815448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:15.816982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:15.818156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f6784344-6f93-40bb-b0c7-f914e86c5a81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1599 microversion: 2.20 time: 0.171748 Jan 29 03:45:15.818705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 96/192] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:15 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:15.869599 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:15.870259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:15.876238 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.876688 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.877506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:15.878109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:15.926642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:15.934122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bdd9b363-05c0-4d64-8a85-8e64e7240a73 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1549 microversion: 2.1 time: 0.167020 Jan 29 03:45:15.934710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 97/193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:15 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:16.017501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:16.024859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-392fa253-1217-4546-b3a5-dde6e423d022 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.158874 Jan 29 03:45:16.025421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 97/194] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:15 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:16.837821 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:16.839260 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:16.848308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:16.849058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:16.850153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:16.850695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:16.952733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:16.952733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:16.958356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:16.959492 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:16.960874 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:16.961675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:17.168126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:17.177661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0bbea03f-324d-4c95-a8a4-ae68efc2bea2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1549 microversion: 2.1 time: 0.230696 Jan 29 03:45:17.178871 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:16 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1549 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:17.184856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:17.185116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:17.185451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:17.196488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:17.196957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:17.197684 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:17.204121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:17.204228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:17.204228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:17.204469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d1c28ec8-daff-4807-8e9d-6255325d62d6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1599 microversion: 2.20 time: 0.368393 Jan 29 03:45:17.204469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 98/196] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:16 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1599 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:45:17.373131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:17.381799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a4507c85-6f6c-4098-8532-c7cbc2f6c132 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.201338 Jan 29 03:45:17.382417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 99/197] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:17 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:18.195498 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:18.196040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:18.202326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.202785 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.203552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.203985 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.219670 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:18.220278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:18.227222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.227671 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.228457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.228893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.347621 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:18.355968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-da0de060-815e-46a1-8198-559498da7dd5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1668 microversion: 2.1 time: 0.164103 Jan 29 03:45:18.356531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:18 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:18.372326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:18.373001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:18.378539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:18.379179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.379627 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.380404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.380831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.386555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:18.388050 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:18.389663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-41cfc214-a912-460e-a4c7-bcabbed145bb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1718 microversion: 2.20 time: 0.173190 Jan 29 03:45:18.390419 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 100/199] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:45:18 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:45:18.399189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:18.399780 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:18.411782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-03a967c3-06d9-4041-b6ca-b6e45bff29cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/ips" status: 200 len: 145 microversion: 2.1 time: 0.038620 Jan 29 03:45:18.411782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 100/200] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:45:18 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:45:18.411963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.411963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.411963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.411963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.427378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:18.428036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:18.433942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.434554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.435447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:18.436004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:18.463008 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ac1850a1-7a7f-4d26-9cd6-fa33599fb3d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/ips" status: 200 len: 152 microversion: 2.20 time: 0.039142 Jan 29 03:45:18.464042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 101/201] 10.222.0.16 () {60 vars in 1288 bytes} [Sat Jan 29 03:45:18 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:45:18.571700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:18.579677 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-28ec350e-5eab-4df8-930c-43307c097a6b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.184336 Jan 29 03:45:18.589044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:18 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:19.597103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:19.597788 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:19.604545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:19.606372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:19.606372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:19.606372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:19.737229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:19.744525 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1a3933fd-3563-43e0-aca4-ae1be7aacde6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.151041 Jan 29 03:45:19.745084 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 102/203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:19 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:20.760807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:20.761404 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:20.768307 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:20.768750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:20.769519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:20.769949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:20.908828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:20.916101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9c624f2d-1390-49b6-98ca-7e34a100d37b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.158986 Jan 29 03:45:20.916662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 102/204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:20 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:21.932728 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:21.933270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:21.939646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:21.940100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:21.940875 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:21.941309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:22.072693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:22.080376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-69b8304f-a295-464d-a1b6-441d9fb7b6fd tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.151362 Jan 29 03:45:22.080942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 103/205] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:21 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:23.096433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:23.097033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:23.103462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:23.103911 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:23.104696 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:23.105117 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:23.240398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:23.247523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1584bbf6-0ad3-4ade-8f8c-ec5bf832fda8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.154741 Jan 29 03:45:23.248588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:23 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:24.264355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:24.264955 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:24.271964 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:24.278628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:24.278628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:24.278628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:24.462313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:24.469553 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4e3ef29c-7c14-4f42-a188-0d3d08635dce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.208646 Jan 29 03:45:24.470167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 104/207] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:24 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:25.486055 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:25.486721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:25.493008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:25.493453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:25.494319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:25.494754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:25.637777 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:25.645872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-763ac858-39cb-4804-8089-baf367c64bed tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.163457 Jan 29 03:45:25.646991 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 104/208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:25 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:26.058908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1893704737", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "4191093a-3e75-431e-ba6a-0a5e62dd1238"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:26.107832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] validate_networks() for [('4191093a-3e75-431e-ba6a-0a5e62dd1238', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:45:26.479344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:45:26.479808 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:45:26.480319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:45:26.480722 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:45:26.481132 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:45:26.489746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:26.490227 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:26.491034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:26.491465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:26.507534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:45:26.511471 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for user 82e533dc110e44f0af37569d8c1b8522 and project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:45:26.523687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:45:26.525978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:45:26.663316 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:26.664541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:26.670877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:26.671329 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:26.671979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-91657f27-4285-4bd5-86bb-4663df53fd9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616623 Jan 29 03:45:26.673064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:26.673064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:26.673293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 105/209] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:45:26.682620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a038b4fe-f685-425c-bf6b-6a20dbc5cc33 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:26.683232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a038b4fe-f685-425c-bf6b-6a20dbc5cc33 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:26.753350 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a038b4fe-f685-425c-bf6b-6a20dbc5cc33 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:26.760856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a038b4fe-f685-425c-bf6b-6a20dbc5cc33 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1218 microversion: 2.1 time: 0.081925 Jan 29 03:45:26.761430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:26 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:26.844028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:26.853667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ef0489a6-3963-472d-b075-1e5840395ef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.193902 Jan 29 03:45:26.854277 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:26 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:27.778239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:27.778842 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:27.786906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:27.787350 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:27.788720 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:27.788720 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:27.850228 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:27.860378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e98d49d4-afa0-4478-9cdc-e2b2041a68d8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1222 microversion: 2.1 time: 0.083297 Jan 29 03:45:27.860378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:27 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:27.870645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:27.871242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:27.877648 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:27.878096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:27.878955 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:27.879392 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:28.020385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:28.028012 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b1a7a83d-e9f9-4614-961c-37bc2094b898 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.161009 Jan 29 03:45:28.028579 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 106/213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:27 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:28.875778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:28.876314 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:28.885117 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:28.885292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:28.886072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:28.886629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:28.950140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:28.959021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-336f6f44-8da7-4fcf-bff0-f3ca8b5a7e68 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1270 microversion: 2.1 time: 0.087469 Jan 29 03:45:28.969289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:28 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:29.045458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:29.046227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:29.053555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:29.054002 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:29.054821 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:29.055320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:29.194099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:29.201603 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-46a123fd-8ce5-44f1-aeb4-6051433c925e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.159803 Jan 29 03:45:29.202185 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:29 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:29.977609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:29.978221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:29.985267 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:29.985693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:29.986493 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:29.986918 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:30.219283 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:30.220783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:30.228446 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:30.229251 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:30.231937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:30.231937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:30.340906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:30.348293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4d3897ec-42d3-465b-b4f3-6e30b68f52e6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.374397 Jan 29 03:45:30.348854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:29 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:30.386819 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:30.387461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cac7f333-57d9-4d88-aeb1-88b9ee3c1425 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.172467 Jan 29 03:45:30.388033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 108/217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:30 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:31.164019 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-88ed75ea-58f9-4d40-8583-4ecafac7b914 req-8d96d2e9-5234-42eb-baff-547f780db150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9a9257-3fe8-4070-a394-1414e2841f9d", "tag": "67b0b6c1-cb7b-438f-a2e1-afa6543d4e99"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:31.165609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:31.165609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:31.173634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-88ed75ea-58f9-4d40-8583-4ecafac7b914 req-8d96d2e9-5234-42eb-baff-547f780db150 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:31.176957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-88ed75ea-58f9-4d40-8583-4ecafac7b914 req-8d96d2e9-5234-42eb-baff-547f780db150 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:31.184894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-88ed75ea-58f9-4d40-8583-4ecafac7b914 req-8d96d2e9-5234-42eb-baff-547f780db150 service nova] Creating event network-changed:67b0b6c1-cb7b-438f-a2e1-afa6543d4e99 for instance af9a9257-3fe8-4070-a394-1414e2841f9d on hv-cinder-82694 Jan 29 03:45:31.190498 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-88ed75ea-58f9-4d40-8583-4ecafac7b914 req-8d96d2e9-5234-42eb-baff-547f780db150 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030043 Jan 29 03:45:31.191065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 110/218] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:31.364793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:31.367390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:31.371719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:31.372172 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:31.372996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:31.373421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:31.405750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:31.406529 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:31.415088 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:31.415540 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:31.417160 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:31.417771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:31.512397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:31.521887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a3af6d47-03ae-477a-a8a7-f081c953aaa9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.160565 Jan 29 03:45:31.523697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:31 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:31.631793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:31.638906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-78e55b87-c46e-4063-80e8-dadc8a5bdf64 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.237787 Jan 29 03:45:31.639466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 111/220] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:31 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:32.540652 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:32.541257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:32.547737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:32.548182 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:32.548962 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:32.549399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:32.655344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:32.658491 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:32.666122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:32.666823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:32.667776 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:32.668886 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:32.698211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:32.709700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ebe4078e-8915-4d1d-8224-142417f2029f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.172713 Jan 29 03:45:32.710334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 110/221] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:32 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:32.821252 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:32.829628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-64331dd8-1d1d-44cf-9780-df78397fa8d6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.177901 Jan 29 03:45:32.830197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:32 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:33.726306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:33.726912 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:33.733071 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:33.742862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:33.742862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:33.742862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:33.847080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:33.847818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:33.854233 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:33.855201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:33.855918 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:33.856344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:33.875487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:33.877156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0414ebb1-690a-49f3-a3ab-d6d5295200b4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.154392 Jan 29 03:45:33.877757 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:33 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:34.032951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:34.041879 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bdc1ffc6-906d-4f5e-a86e-58429cc0063a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.198551 Jan 29 03:45:34.042494 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 113/224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:33 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:34.306724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:34.307195 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:34.313036 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.313475 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:34.314259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.314701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:34.338382 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:45:34.646121 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-febee5b2-9172-4d93-b657-99ebaa3384df tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 204 len: 0 microversion: 2.1 time: 0.342859 Jan 29 03:45:34.647141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 112/225] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:45:34 2022] DELETE /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:45:34.655046 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:34.655658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:34.662120 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.662601 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:34.663377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.663816 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:34.796795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:34.804714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-21880536-5604-4f02-8fb1-fcd309c39d1b tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1554 microversion: 2.1 time: 0.153334 Jan 29 03:45:34.805312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:34 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:34.894791 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:34.895607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:34.902553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.903005 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:34.903904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:34.904393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:35.039773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:35.051305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f25c858b-2bd7-46b0-bf00-0c95c7c8bb1a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.160958 Jan 29 03:45:35.060650 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 113/227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:34 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:35.060760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:35.060760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:35.067292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:35.067742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:35.068557 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:35.068993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:35.204529 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:35.212151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4e7d1bc9-fabe-4ffd-8fef-987ba66da1f9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.156338 Jan 29 03:45:35.212713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 115/228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:35 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:35.821526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:35.822097 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:35.827902 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:35.828349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:35.829126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:35.829560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:35.975174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:35.982894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-503b49ae-de57-4c22-82f8-7b1c08f9e0f5 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1554 microversion: 2.1 time: 0.165112 Jan 29 03:45:35.983651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 114/229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:35 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:36.067659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:36.068265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:36.074448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:36.074843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:36.075611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:36.076042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:36.213262 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:36.221202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-14fa4037-3fbf-472d-b3e4-1eba7e2b4003 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.157152 Jan 29 03:45:36.221750 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 116/230] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:36 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:36.229217 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:36.230303 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:36.240064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:36.240507 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:36.241290 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:36.241722 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:36.371793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:36.379365 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5c5c3bfe-9395-435f-9f73-3fbe94687159 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.154577 Jan 29 03:45:36.379928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 115/231] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:36 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:36.999894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:37.000496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:37.006356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.006802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.007560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.007987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.154472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:37.162914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ea2114d2-9964-40f4-9a17-6eea49e2ad12 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1554 microversion: 2.1 time: 0.166755 Jan 29 03:45:37.163472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 117/232] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:36 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:37.237075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:37.237684 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:37.243928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.244375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.245148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.245581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.377942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:37.389524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2cd90544-ef19-420f-b316-1ced9aed601c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.155455 Jan 29 03:45:37.391196 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 116/233] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:37 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:37.399392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:37.399839 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:37.405895 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.406375 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.407139 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:37.407569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:37.542348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:37.550485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-810cd62f-18c7-4523-9d88-055577661752 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.155229 Jan 29 03:45:37.551042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 118/234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:37 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:38.179876 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:38.180573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:38.187781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.188295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.189837 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.190326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.366470 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:38.374405 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2c89bd90-d7cd-4e53-bee2-3f8552fc07c8 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1554 microversion: 2.1 time: 0.198411 Jan 29 03:45:38.375621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 117/235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:38 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:38.411460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:38.412076 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:38.418715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.419199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.419976 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.420410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.567750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:38.568286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:38.574209 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.574667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.575479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.575914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.588697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:38.596604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1d453735-d2cb-4635-b1af-a00ce5c34c41 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.189220 Jan 29 03:45:38.597246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 119/236] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:38 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:38.707734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-9f1cf2c2-0462-4465-80b8-a8ac19899872 req-6300ff86-32d8-4f90-af71-d4d5a5473cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0238dfa-64ff-4122-8f56-0f4430b66bbb", "name": "network-vif-deleted", "tag": "344261af-89bd-4849-88f4-09b55da6299e"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:38.709719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:38.709719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:38.716513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-9f1cf2c2-0462-4465-80b8-a8ac19899872 req-6300ff86-32d8-4f90-af71-d4d5a5473cf8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:38.718792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-9f1cf2c2-0462-4465-80b8-a8ac19899872 req-6300ff86-32d8-4f90-af71-d4d5a5473cf8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:38.720256 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:38.727495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ab350b4c-1565-4197-8019-a0fd26db0701 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.163577 Jan 29 03:45:38.728264 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 118/237] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:38 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:38.728473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-9f1cf2c2-0462-4465-80b8-a8ac19899872 req-6300ff86-32d8-4f90-af71-d4d5a5473cf8 service nova] Creating event network-vif-deleted:344261af-89bd-4849-88f4-09b55da6299e for instance d0238dfa-64ff-4122-8f56-0f4430b66bbb on hv-cinder-82694 Jan 29 03:45:38.733763 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-9f1cf2c2-0462-4465-80b8-a8ac19899872 req-6300ff86-32d8-4f90-af71-d4d5a5473cf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029560 Jan 29 03:45:38.735395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 120/238] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:45:39.402722 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:39.403432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:39.410570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.413484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.413484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.413484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.484787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:39.494198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ac3c8c48-14c0-402c-a56e-0057e4842d15 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1346 microversion: 2.1 time: 0.096623 Jan 29 03:45:39.494883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 119/239] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:39 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:39.613012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:39.613705 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:39.620212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.620658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.621465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.621863 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.744700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:39.747221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:39.753689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.762773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.762773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.762773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.770480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:39.778366 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-99e228a2-afcd-4d53-a521-eb1e0339d231 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.169272 Jan 29 03:45:39.778947 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 121/240] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:39 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:39.896480 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:39.905148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-82dadb91-d141-4d33-8140-d5047f6fecc5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.164037 Jan 29 03:45:39.905654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 120/241] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:39 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:39.975430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-a806d4a3-ed28-40d1-9aa6-145400b0b812 req-bc1127d8-0891-423e-bbf4-d49d144e54a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a9257-3fe8-4070-a394-1414e2841f9d", "name": "network-vif-plugged", "status": "completed", "tag": "67b0b6c1-cb7b-438f-a2e1-afa6543d4e99"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:39.977002 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:45:39.977002 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:45:39.984403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-a806d4a3-ed28-40d1-9aa6-145400b0b812 req-bc1127d8-0891-423e-bbf4-d49d144e54a5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:39.984836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-a806d4a3-ed28-40d1-9aa6-145400b0b812 req-bc1127d8-0891-423e-bbf4-d49d144e54a5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:39.995226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-a806d4a3-ed28-40d1-9aa6-145400b0b812 req-bc1127d8-0891-423e-bbf4-d49d144e54a5 service nova] Creating event network-vif-plugged:67b0b6c1-cb7b-438f-a2e1-afa6543d4e99 for instance af9a9257-3fe8-4070-a394-1414e2841f9d on hv-cinder-82694 Jan 29 03:45:40.000410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-a806d4a3-ed28-40d1-9aa6-145400b0b812 req-bc1127d8-0891-423e-bbf4-d49d144e54a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028084 Jan 29 03:45:40.004931 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 122/242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:40.511743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:40.512155 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:40.519087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.519619 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.520404 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.520835 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.552567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.553007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.553495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lazy-loading 'fault' on Instance uuid d0238dfa-64ff-4122-8f56-0f4430b66bbb {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:45:40.602307 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:40.610152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-44011b69-dadf-4f63-874e-1350595163ae tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1351 microversion: 2.1 time: 0.102510 Jan 29 03:45:40.610774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 121/243] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:40 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:40.800784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:40.801479 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:40.807705 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.808149 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.808919 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.809353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.921737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:40.922377 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:40.928198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.928662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.929436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:40.929982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:40.941270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:40.948848 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ff62d30b-d688-4eee-8be2-a06aebf29f4a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.152519 Jan 29 03:45:40.949600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 123/244] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:40 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:41.068042 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:41.075472 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-453f5bb1-fa48-48b1-977c-412789600b18 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.157416 Jan 29 03:45:41.076033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 122/245] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:40 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:41.627467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:41.628072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:41.633915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:41.635243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:41.635243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:41.635674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:41.665902 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:41.666358 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:41.666887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lazy-loading 'fault' on Instance uuid d0238dfa-64ff-4122-8f56-0f4430b66bbb {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:45:41.711597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:41.719866 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ef077da7-caf1-45de-913b-22f6f4f36791 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1351 microversion: 2.1 time: 0.096596 Jan 29 03:45:41.720419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 124/246] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:41 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:41.965647 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:41.966278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:41.973045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:41.973488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:41.974288 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:41.974721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.095231 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:42.104730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:42.111147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:42.111595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.112384 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:42.112818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.115184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:42.125262 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b1c2557f-ccd3-49f3-b783-905a56b70995 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.163026 Jan 29 03:45:42.126163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 123/247] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:41 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:42.249417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:42.256673 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-aa15e7d3-9958-4412-9d6a-0a063fed6075 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.165625 Jan 29 03:45:42.257244 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 125/248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:42 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:42.736730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:42.737354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:42.743574 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:42.744018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.744821 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:42.745251 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.778547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:42.778990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:42.779424 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lazy-loading 'fault' on Instance uuid d0238dfa-64ff-4122-8f56-0f4430b66bbb {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:45:42.818608 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7390fc7d883040ebbcb78b4a12c13bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654101f4db1547ce8e1bea070af930d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:42.826051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d8929b34-5f53-47a6-99e0-18f3edad03c1 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 200 len: 1351 microversion: 2.1 time: 0.093013 Jan 29 03:45:42.826652 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 124/249] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:42 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:43.146271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:43.146889 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:43.153119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.153583 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.154388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.154831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.274895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:43.275529 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:43.283393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.283883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.284794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.285341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.291032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:43.299091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-aad093b3-7650-41c4-9ff1-d88926226613 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.156669 Jan 29 03:45:43.299922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 126/250] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:43 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:43.439415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:43.451640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-89857d56-cb15-49a1-80e0-0e4966193fd0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.181448 Jan 29 03:45:43.452517 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 125/251] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:43 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:43.845098 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:43.845704 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:43.851608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.852045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.852804 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.853235 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.865926 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] HTTP exception thrown: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. Jan 29 03:45:43.866535 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Returning 404 to user: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:45:43.867333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-18ec060b-96d0-4931-8712-d16f169468e4 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 404 len: 111 microversion: 2.1 time: 0.026549 Jan 29 03:45:43.867844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 127/252] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:43 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:45:43.964898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:43.965867 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:43.971636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.972073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.972832 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:43.973255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:43.985198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] HTTP exception thrown: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. Jan 29 03:45:43.985765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Returning 404 to user: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:45:43.986663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1c1b124b-6291-4fb8-8583-3aabd9ed2f68 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.025511 Jan 29 03:45:43.987179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 126/253] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:43 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb/os-volume_attachments => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:45:44.315303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:44.315908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:44.322091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:44.322575 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:44.323360 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:44.323782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:44.465839 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:44.468417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:44.469015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:44.473475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9bc574e5-950c-4222-9cd6-99fb8112cce7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.162280 Jan 29 03:45:44.474025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 128/254] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:44 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:44.475345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:44.475837 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:44.476602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:44.477028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:44.613445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:44.620876 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-beadc4da-d6c9-4eee-a4c5-bf4ba287d4e6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.156045 Jan 29 03:45:44.621453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 127/255] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:44 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:45.490639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:45.491236 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:45.497426 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:45.497868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:45.498655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:45.499576 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:45.634167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:45.641126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:45.641126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:45.642520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5787bbf9-4ae0-47bc-a6d2-597adbd69c3d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.155445 Jan 29 03:45:45.643109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 129/256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:45 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:45.646493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:45.646998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:45.647837 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:45.648273 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:45.780188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:45.787486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-641623de-e9ea-4b4b-bbe5-ae9828f0b2c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.152917 Jan 29 03:45:45.788057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 128/257] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:45 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:46.660276 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:46.660872 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:46.667099 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:46.667549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:46.668325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:46.668755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:46.800025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:46.806082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:46.807048 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:46.807422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-51c86c65-8427-4f7f-a6c3-b3bc5da66d2e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.150771 Jan 29 03:45:46.807988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 130/258] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:46 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:46.814327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:46.814892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:46.815701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:46.816127 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:46.953099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:46.960366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a0cc523e-bba9-4fe5-97ad-ec88c28a02c3 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.159090 Jan 29 03:45:46.960928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 129/259] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:46 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:47.826357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:47.826892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:47.833252 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:47.833691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:47.834483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:47.834939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:47.974161 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:47.977168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:47.977775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:47.982534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ec99062c-f29d-41ca-92c6-827326c69f7f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1318 microversion: 2.1 time: 0.159976 Jan 29 03:45:47.983205 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 131/260] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:47 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:47.984708 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:47.985210 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:47.988202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:47.988202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:48.118778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:48.126486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-33a8b14d-9319-41f3-b768-3a874d37479d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.153117 Jan 29 03:45:48.131538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 130/261] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:47 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:48.423922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:48.424730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:48.431283 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:48.431733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:48.432520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:48.432955 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:48.450760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] HTTP exception thrown: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. Jan 29 03:45:48.451639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Returning 404 to user: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:45:48.453513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b818bc96-fe7c-4969-a6d4-3bfddab7aae9 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 404 len: 111 microversion: 2.1 time: 0.033934 Jan 29 03:45:48.458533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 132/262] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:45:48 2022] DELETE /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:45:48.463488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:48.470578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] [instance: d0238dfa-64ff-4122-8f56-0f4430b66bbb] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:48.470578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:48.470892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:48.471504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:48.471936 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:48.485789 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] HTTP exception thrown: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. Jan 29 03:45:48.486406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] Returning 404 to user: Instance d0238dfa-64ff-4122-8f56-0f4430b66bbb could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:45:48.487236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-70410cab-3a82-4d83-bb69-867b1dbd9581 tempest-DeleteServersTestJSON-1124593692 tempest-DeleteServersTestJSON-1124593692-project] 10.222.0.16 "GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb" status: 404 len: 111 microversion: 2.1 time: 0.027461 Jan 29 03:45:48.487989 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 131/263] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:48 2022] GET /compute/v2.1/servers/d0238dfa-64ff-4122-8f56-0f4430b66bbb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:45:48.999475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:49.000092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:49.006312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.006759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.007552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.007981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.146807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:49.147486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:49.149523 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:49.155329 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.156295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.157103 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.157540 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.157652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cfcd9e47-ea44-47b8-b044-a60887e99f2a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1508 microversion: 2.1 time: 0.161896 Jan 29 03:45:49.158780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:48 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:49.174980 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "562414ee-1787-4f18-b7e4-368e90b72ea8"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:49.176474 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:49.183179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.183629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.184433 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.184832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.294990 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Invalid volume: volume 562414ee-1787-4f18-b7e4-368e90b72ea8 is already attached to instances: fb51aefd-c927-464c-a843-4291d9f9ec0b Jan 29 03:45:49.295583 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 400 to user: Invalid volume: volume 562414ee-1787-4f18-b7e4-368e90b72ea8 is already attached to instances: fb51aefd-c927-464c-a843-4291d9f9ec0b {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:45:49.296404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9b7b0e0c-206e-4c2d-a399-4c2aabf26c40 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125959 Jan 29 03:45:49.300239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 134/265] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:45:49 2022] POST /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:45:49.358381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:49.358381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fcc1e346-80f8-4f6f-9370-fa38b3f531c8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.214238 Jan 29 03:45:49.358381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 132/266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:49 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:45:49.367159 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:49.367652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:49.373500 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.374501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.375273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.375703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.492505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'services' on Instance uuid fb51aefd-c927-464c-a843-4291d9f9ec0b {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:45:49.814921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-eb9f5f65-5f0e-4653-a6c0-6cf34f53ad60 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments/562414ee-1787-4f18-b7e4-368e90b72ea8" status: 202 len: 0 microversion: 2.1 time: 0.447438 Jan 29 03:45:49.814921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 135/267] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:45:49 2022] DELETE /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments/562414ee-1787-4f18-b7e4-368e90b72ea8 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:45:49.821255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:49.822239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:49.828138 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.828586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.829362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:49.829906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:49.859674 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c5c7e7a3-d79d-4307-9236-112b2cd1c6fa tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jan 29 03:45:49.860293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 133/268] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:49 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:50.376107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:50.377013 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:50.383536 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:50.384238 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:50.385091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:50.385620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:50.537305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:50.544573 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-87228482-7e71-4c3a-9403-8f484309a817 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.174308 Jan 29 03:45:50.545126 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 136/269] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:50 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:50.871128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:50.872174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:50.879069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:50.879520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:50.880325 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:50.880760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:50.910946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a7efa52e-446a-4a6d-a92d-e0685751d4c8 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Jan 29 03:45:50.911505 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:50 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:51.560632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:51.561242 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:51.567473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:51.567914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:51.568672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:51.569186 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:51.705357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:51.712714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-97bd15b6-1447-48fa-8b09-ee41a8ddc11f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.155798 Jan 29 03:45:51.718784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:51 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:51.922968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:51.924744 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:51.932595 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:51.933421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:51.934531 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:51.935309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:51.970458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6cff1b89-25f9-47a7-b6a0-316f3381b36c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052415 Jan 29 03:45:51.971555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 135/272] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:51 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:52.729864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:52.736374 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:52.736831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:52.737279 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:52.738060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:52.738521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:52.902357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:52.902357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ef6f5ea3-f808-459a-a4f8-8d9130832a75 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.174478 Jan 29 03:45:52.902357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:52 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:52.988512 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:52.988961 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:52.994754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:52.995200 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:52.995974 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:52.996403 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:53.026768 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1c8f5046-e140-4090-a29b-c2d7a13e8f53 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Jan 29 03:45:53.027441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 136/274] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:52 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:45:53.918148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:53.919323 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:53.963992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:53.963992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:53.963992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:53.963992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:54.043990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:54.044975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:54.051774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:54.052220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:54.054320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:54.054320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:54.066214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:54.073899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6b2abdc1-09e9-4966-a449-8fe5b0e79cb0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.159330 Jan 29 03:45:54.074639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 139/275] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:53 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:54.091086 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-42c6c5c2-0bb5-4953-a500-d382d7d82d9f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051111 Jan 29 03:45:54.091649 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 137/276] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:45:54 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 29 03:45:54.261640 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1421791989", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "4191093a-3e75-431e-ba6a-0a5e62dd1238"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:45:54.319658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] validate_networks() for [('4191093a-3e75-431e-ba6a-0a5e62dd1238', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:45:54.713660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:45:54.714320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:45:54.714969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:45:54.715379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:45:54.715789 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:45:54.736565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:54.737020 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:54.737848 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:54.738490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:54.761751 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:45:54.766426 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for user 82e533dc110e44f0af37569d8c1b8522 and project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:45:54.777533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:45:54.780030 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:45:54.928174 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-789494e5-e5ad-433a-ade5-5fd953e57c0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670436 Jan 29 03:45:54.929543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 140/277] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:45:54.940100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7d24a909-0034-46a5-bdbf-0e8e124d4301 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:54.941874 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7d24a909-0034-46a5-bdbf-0e8e124d4301 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:55.012010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7d24a909-0034-46a5-bdbf-0e8e124d4301 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:55.018534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7d24a909-0034-46a5-bdbf-0e8e124d4301 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1218 microversion: 2.1 time: 0.083219 Jan 29 03:45:55.019101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 138/278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:54 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:55.091830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:55.092556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:55.099630 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:55.100228 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:55.101022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:55.101526 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:55.267541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:55.275909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fbdd2b1f-49a0-4672-859d-a835c224a212 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.188804 Jan 29 03:45:55.276584 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 141/279] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:55 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:56.035564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:56.036086 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:56.042465 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:56.043004 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:56.043777 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:56.044208 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:56.106809 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:56.114152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7ce96618-50e5-4396-b95b-cf573ff3cecc tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1222 microversion: 2.1 time: 0.082418 Jan 29 03:45:56.114754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 139/280] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:56 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:56.293563 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:56.294077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:56.300889 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:56.301337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:56.302326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:56.302561 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:56.449965 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:56.457319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ec2ca534-ba7a-4397-8873-67942977709f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.167480 Jan 29 03:45:56.457874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 142/281] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:56 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:57.130427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:57.131587 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:57.141796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:57.142468 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:57.143459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:57.144041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:57.205216 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:57.212764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8f5d381a-e576-4908-9c27-9e45f1fe6cc0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1270 microversion: 2.1 time: 0.085902 Jan 29 03:45:57.213338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 140/282] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:57 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:57.474473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:57.475758 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:57.483815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:57.484258 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:57.485349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:57.485775 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:57.820134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:57.834303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0d548a79-842a-4abc-bae7-a7e278e69e68 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.363655 Jan 29 03:45:57.834790 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 143/283] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:57 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:58.234879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:58.235504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:58.241739 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:58.242212 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:58.242981 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:58.243592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:58.384082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:58.391349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e56ce92d-c28d-4fcd-86d6-1690dbfd84b5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.160830 Jan 29 03:45:58.391920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 141/284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:58 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:58.851551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:58.852152 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:58.858519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:58.858973 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:58.859742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:58.860175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:58.998073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:59.005998 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-681c9d52-49a1-4877-8c1a-d2890e34b528 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.158034 Jan 29 03:45:59.006608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 144/285] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:58 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:45:59.408434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:45:59.409033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:45:59.415192 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:59.415637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:59.416403 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:45:59.416833 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:45:59.554988 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:45:59.562867 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-639ad6d7-7315-4ebd-9e4b-5620e302fc0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.158040 Jan 29 03:45:59.563425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 142/286] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:45:59 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:00.023646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:00.024245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:00.031062 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:00.031503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:00.032307 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:00.032736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:00.164311 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:00.171755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5f398d8d-60d3-4849-bdc1-7c9848d9987d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.152018 Jan 29 03:46:00.172319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 145/287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:00 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:00.579530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:00.580127 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:00.587137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:00.587583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:00.588372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:00.588808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:00.723925 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:00.731493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8b52e1c0-0235-479a-b7e1-1185240252d9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.156079 Jan 29 03:46:00.732249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 143/288] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:00 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:01.012436 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-4ce1925c-0417-42a9-b146-9dbbfba6b040 req-2ee3e19d-6679-45c1-8a5a-95c124887cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4648ab-9197-424a-bbd3-154000deff15", "tag": "a45095a8-11a0-4b26-80eb-17ac9fcbb199"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:01.014024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:46:01.014024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:46:01.021746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-4ce1925c-0417-42a9-b146-9dbbfba6b040 req-2ee3e19d-6679-45c1-8a5a-95c124887cb7 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:01.022322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-4ce1925c-0417-42a9-b146-9dbbfba6b040 req-2ee3e19d-6679-45c1-8a5a-95c124887cb7 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:01.034079 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-4ce1925c-0417-42a9-b146-9dbbfba6b040 req-2ee3e19d-6679-45c1-8a5a-95c124887cb7 service nova] Creating event network-changed:a45095a8-11a0-4b26-80eb-17ac9fcbb199 for instance 0c4648ab-9197-424a-bbd3-154000deff15 on hv-cinder-82694 Jan 29 03:46:01.038952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-4ce1925c-0417-42a9-b146-9dbbfba6b040 req-2ee3e19d-6679-45c1-8a5a-95c124887cb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030030 Jan 29 03:46:01.039555 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 146/289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:01.189232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:01.189891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:01.195733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:01.196182 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:01.196978 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:01.197414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:01.350286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:01.363431 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ae510f29-7917-4926-bef0-bad95e171644 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.178476 Jan 29 03:46:01.369001 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 144/290] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:01 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:01.749109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:01.749799 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:01.756346 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:01.756800 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:01.757586 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:01.758018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:01.927359 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:01.934599 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dd85fe73-b05d-4c73-9567-1f8de1fd8a79 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.189908 Jan 29 03:46:01.935157 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 147/291] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:01 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:02.380760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:02.381397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:02.387778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:02.388216 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:02.388996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:02.389433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:02.589268 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:02.597298 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-da7f782e-a1f2-40e1-a7a7-8c99e9fb3071 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.220194 Jan 29 03:46:02.606723 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 145/292] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:02 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:02.950947 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:02.951575 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:02.958434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:02.958874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:02.959631 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:02.960056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:03.099196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:03.106318 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-16d42426-1815-4dfe-b1fa-28636367a93f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.158980 Jan 29 03:46:03.106874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 148/293] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:02 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:03.614678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:03.615333 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:03.623085 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:03.623866 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:03.625118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:03.626290 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:03.761305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:03.769288 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-46be848e-cfb9-42c8-b105-1b16896a819f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1521 microversion: 2.1 time: 0.158917 Jan 29 03:46:03.769878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 146/294] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:03 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:04.123774 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:04.124943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:04.131942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.132388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:04.136197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.136197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:04.281976 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:04.292063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-55677868-f211-4a24-ac6e-2ea87edf6620 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.172236 Jan 29 03:46:04.292714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 149/295] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:04 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:04.787024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:04.787624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:04.798338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.798338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:04.798338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.798338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:04.940127 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:04.947346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ef5577e6-947f-4e40-aee1-6ffa5b60206b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1501 microversion: 2.1 time: 0.164149 Jan 29 03:46:04.947914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 147/296] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:04 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:04.964187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:04.965146 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:04.970985 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.971614 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:04.972377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:04.972955 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:05.117442 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:05.125611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-daa99aec-e4dc-44b6-9435-a044d6ef7fad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1514 microversion: 2.1 time: 0.164471 Jan 29 03:46:05.138173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 150/297] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:04 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:05.311220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:05.311818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:05.318189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:05.318637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:05.319399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:05.319827 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:05.466835 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:05.474918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-159913a6-e99d-444b-97a4-2f08b4abf898 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.167166 Jan 29 03:46:05.475596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 148/298] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:05 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:06.492402 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:06.493065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:06.499419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:06.499894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:06.500684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:06.501115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:06.677629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:06.688890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9cba2574-0e81-4ed1-857e-8190b10fe47a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.198788 Jan 29 03:46:06.689723 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 151/299] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:06 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:07.085101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:07.086030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:07.092343 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.092828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.093652 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.094099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.132211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'flavor' on Instance uuid 333eec8c-4437-4fe4-9440-e0210b9b6b71 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:46:07.438295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-adb7a58a-eeb6-48d1-88d6-917bdef18c93 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action" status: 200 len: 32 microversion: 2.1 time: 0.356646 Jan 29 03:46:07.438948 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 149/300] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:46:07 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:46:07.447741 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:07.448463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:07.469561 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.471846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.471846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.471846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.670876 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:07.678989 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5376ceef-04c0-4779-b7af-c82bf5f7c51c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.234883 Jan 29 03:46:07.679550 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 152/301] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:07 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:07.708752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:07.709767 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:07.717498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.718156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.718991 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:07.719439 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:07.864151 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:07.871747 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8853f61d-c5b7-4786-baf0-dc0a3b53dd4b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.167978 Jan 29 03:46:07.872442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 150/302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:07 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:08.532174 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-afc3ed81-7039-41e9-b314-72ae96cefb77 req-1a592f09-51fd-4112-a966-427074454482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4648ab-9197-424a-bbd3-154000deff15", "name": "network-vif-plugged", "status": "completed", "tag": "a45095a8-11a0-4b26-80eb-17ac9fcbb199"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:08.533725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:46:08.533725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:46:08.540909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-afc3ed81-7039-41e9-b314-72ae96cefb77 req-1a592f09-51fd-4112-a966-427074454482 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:08.541390 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-afc3ed81-7039-41e9-b314-72ae96cefb77 req-1a592f09-51fd-4112-a966-427074454482 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:08.552200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-afc3ed81-7039-41e9-b314-72ae96cefb77 req-1a592f09-51fd-4112-a966-427074454482 service nova] Creating event network-vif-plugged:a45095a8-11a0-4b26-80eb-17ac9fcbb199 for instance 0c4648ab-9197-424a-bbd3-154000deff15 on hv-cinder-82694 Jan 29 03:46:08.557051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-afc3ed81-7039-41e9-b314-72ae96cefb77 req-1a592f09-51fd-4112-a966-427074454482 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029322 Jan 29 03:46:08.558026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 153/303] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:08.697084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:08.697847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:08.704910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:08.705497 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:08.706317 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:08.706756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:08.842921 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:08.850579 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-650f117c-6e7b-475d-82f7-9f5e72ee34ab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.157495 Jan 29 03:46:08.851211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 151/304] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:08 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:08.889783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:08.891214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:08.897397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:08.897842 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:08.898657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:08.899088 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:09.108123 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:09.115988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0fdd6aa8-e20a-437d-bd68-4c78c62c9d9a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.230175 Jan 29 03:46:09.116552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 154/305] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:08 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:09.867255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:09.867925 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:09.874368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:09.874815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:09.875623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:09.876057 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:10.011713 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:10.019177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6812bb13-9e04-4d99-a6ab-b5cf172dc262 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.155463 Jan 29 03:46:10.026804 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 152/306] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:09 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:10.133705 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:10.134515 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:10.140430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:10.140876 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:10.141653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:10.142082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:10.280952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:10.289379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-032a226c-5e5e-4412-a51f-c0d8202bdb26 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1318 microversion: 2.1 time: 0.159546 Jan 29 03:46:10.290428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 155/307] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:10 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:11.036291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:11.036894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:11.042934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:11.043383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:11.044148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:11.044575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:11.175494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:11.183210 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-04a58ba7-350b-4bd4-9b17-b22aaed3542d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.150929 Jan 29 03:46:11.183774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 153/308] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:11 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:11.307458 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:11.308158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:11.317299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:11.317893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:11.318773 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:11.319303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:11.458001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:11.466950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-793560af-5aae-41c8-bc0c-9f0e96eea8ce tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1508 microversion: 2.1 time: 0.163027 Jan 29 03:46:11.467518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:11 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:12.201492 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:12.202838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:12.210030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:12.210692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:12.211474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:12.212064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:12.406768 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:12.414669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f494eb11-0d65-4597-a591-25731a510026 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.217801 Jan 29 03:46:12.415235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 154/310] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:12 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:13.412459 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd047070-ae24-44b4-9251-f725fa40f113"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:13.413522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:13.419844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:13.420289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:13.421060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:13.421492 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:13.431728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:13.432468 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:13.439740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:13.440187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:13.441020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:13.441477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:13.582408 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:13.593247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-acda9f59-0603-42a8-aeb9-b77b3c49b882 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.165387 Jan 29 03:46:13.593816 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 155/311] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:13 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:14.334942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a3835d7d-8ffb-4c3f-920b-5849b4d36fa0 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926150 Jan 29 03:46:14.335559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 157/312] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:13 2022] POST /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:14.610526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:14.611126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:14.617525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:14.617959 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:14.618765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:14.619259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:14.753373 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:14.760954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6225ee3a-5acd-4b73-a2f6-903c283ba392 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.154127 Jan 29 03:46:14.762072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 156/313] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:14 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:15.780121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:15.780804 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:15.786906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:15.787356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:15.791466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:15.791466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:15.929173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:15.936510 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9863a5b5-7f25-4877-8366-5820587e4305 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.160806 Jan 29 03:46:15.939420 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 158/314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:15 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:16.955104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:16.956277 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:16.962687 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:16.963128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:16.963894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:16.964319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:17.114405 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:17.121675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-81bb649b-c5a9-4d9b-9886-1650ee8234c2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.170417 Jan 29 03:46:17.122260 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 157/315] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:16 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:18.139977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:18.140580 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:18.147087 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:18.147536 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:18.148325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:18.148758 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:18.285702 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:18.293029 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f48178ad-2e73-46ab-8c41-fcd42f6f7fff tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.156685 Jan 29 03:46:18.293580 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:18 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:19.310305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:19.310900 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:19.317838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:19.318391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:19.319169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:19.319602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:19.451305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:19.459165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7b2fb8c1-dacb-4e63-940c-d31f7b7be51a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.152510 Jan 29 03:46:19.459760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 158/317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:19 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:19.899199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:19.899735 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:19.905852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:19.906341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:19.907139 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:19.907599 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:19.930289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lazy-loading 'flavor' on Instance uuid 8f5813a3-d10f-42ef-99a5-50aa1af18f3a {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:46:20.476428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:20.477046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:20.483375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:20.483818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:20.484593 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:20.485027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:20.569682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2ee9f962-2122-49fd-932b-89006484cce6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/action" status: 202 len: 0 microversion: 2.20 time: 0.674317 Jan 29 03:46:20.573005 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 160/318] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Jan 29 03:46:19 2022] POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:46:20.578854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:20.579559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:20.586408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:20.586860 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:20.587648 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:20.588119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:20.624114 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:20.634502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-edb4de34-7609-4592-b29b-36e674d420a2 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.161506 Jan 29 03:46:20.635175 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 159/319] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:20 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:20.761993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:20.770665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:20.772142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:20.773365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-734aae66-71e7-4e7d-9663-39ea7bf9e5ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.198540 Jan 29 03:46:20.773934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 161/320] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:20 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:21.655425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:21.656025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:21.663204 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:21.663645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:21.664407 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:21.664870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:21.792454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:21.793048 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:21.795143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:21.799270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:21.799707 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:21.800505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:21.800929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:21.802463 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e1cad9a-1515-4fab-a619-9d20dbc4bafb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.150654 Jan 29 03:46:21.803033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 160/321] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:21 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:21.934937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:21.944407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:21.945969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:21.947136 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4278b34e-427c-4ff3-a235-db8c1dae79a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.158357 Jan 29 03:46:21.947678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 162/322] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:21 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:22.818740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:22.821181 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:22.826043 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:22.826919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:22.827500 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:22.827901 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:22.879526 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd047070-ae24-44b4-9251-f725fa40f113"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:22.880617 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:22.888502 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:22.888951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:22.889747 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:22.890205 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:22.985641 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Invalid volume: volume fd047070-ae24-44b4-9251-f725fa40f113 is already attached to instances: 0c4648ab-9197-424a-bbd3-154000deff15 Jan 29 03:46:22.986299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 400 to user: Invalid volume: volume fd047070-ae24-44b4-9251-f725fa40f113 is already attached to instances: 0c4648ab-9197-424a-bbd3-154000deff15 {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:46:22.987184 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9b944627-2dc0-4083-b070-9975a80cb831 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112101 Jan 29 03:46:22.987747 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 163/323] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:22 2022] POST /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:46:22.997279 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:22.998142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:23.007713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.008216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.009201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.009692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.213174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:23.220487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-130eb7f5-21c1-4b92-ac12-16fe8361fcd5 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.405305 Jan 29 03:46:23.221052 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 161/324] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:22 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:23.225896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:23.226859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:23.227108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:23.235495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.235940 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.237409 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.237928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.239209 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:23.243335 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:23.243335 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ee26d1be-b399-4ba4-9240-72a6f1c476d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.254000 Jan 29 03:46:23.243766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 164/325] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:22 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:23.358287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'services' on Instance uuid 0c4648ab-9197-424a-bbd3-154000deff15 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:46:23.695991 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0749ddc9-5c51-4532-9f7b-86ac7c5d83ec tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments/fd047070-ae24-44b4-9251-f725fa40f113" status: 202 len: 0 microversion: 2.1 time: 0.473749 Jan 29 03:46:23.696577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 162/326] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:46:23 2022] DELETE /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments/fd047070-ae24-44b4-9251-f725fa40f113 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:46:23.704595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:23.705583 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:23.711802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.712250 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.713025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:23.713457 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:23.742915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6a4552b3-3d4a-4e92-894b-b06e409b5f83 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jan 29 03:46:23.743460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 165/327] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:23 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:24.237988 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:24.238734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:24.245432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.245880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.246696 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.247137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.263173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:24.263785 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:24.271042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.271490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.272269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.272706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.410044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:24.418180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:24.419688 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:24.420917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a569ef06-8027-448a-9b4f-ecb8a4960891 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.164018 Jan 29 03:46:24.421470 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 166/328] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:24 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:24.431997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:24.440060 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-24a06047-e96a-4ac6-ae24-6916a7125d40 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.205571 Jan 29 03:46:24.440625 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 163/329] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:24 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:24.755528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:24.756834 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:24.762755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.763480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.764496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:24.764928 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:24.795029 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-61ef5144-dd3f-4f96-9a51-d993b28060c9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Jan 29 03:46:24.795842 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 167/330] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:24 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:25.438834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:25.439379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:25.445808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.446298 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.447091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.447519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.457080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:25.461554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:25.466147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.466831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.467821 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.468412 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.626154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:25.634481 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:25.635976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:25.637109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-55865f0b-dcb0-4575-904d-4da7cea36264 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.202076 Jan 29 03:46:25.637669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 164/331] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:25 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:25.778881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:25.788522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0e27c1c8-c69c-4481-8252-4d07af3505ef tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.333215 Jan 29 03:46:25.788522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 168/332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:25 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:25.806669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:25.807643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:25.813393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.813834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.815202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:25.815631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:25.843645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0df98f28-af1f-4f97-8d61-345c7e6c6c73 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040591 Jan 29 03:46:25.844199 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 165/333] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:25 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:46:26.005531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-211439723", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "4191093a-3e75-431e-ba6a-0a5e62dd1238"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:26.055716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] validate_networks() for [('4191093a-3e75-431e-ba6a-0a5e62dd1238', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:46:26.430908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:46:26.431323 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:46:26.431795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:46:26.432201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:46:26.432639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:46:26.442287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.442679 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.443499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.443958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.461578 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:46:26.465528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Getting quotas for user 82e533dc110e44f0af37569d8c1b8522 and project a61fc9a8db7445ca8c465347f41732e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:46:26.476591 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:46:26.478933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:46:26.488047 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8756ba81-4349-4e53-9268-82ae88e2af43"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:26.489894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:26.496015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.496465 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.497228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.498296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.607984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4fc782fb-5e52-4586-b715-898a86c0098d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607064 Jan 29 03:46:26.609345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 169/334] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:46:26.620038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dc73820f-198f-4825-8a76-9913c071a1d5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:26.620684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dc73820f-198f-4825-8a76-9913c071a1d5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:26.694043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dc73820f-198f-4825-8a76-9913c071a1d5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:26.701339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dc73820f-198f-4825-8a76-9913c071a1d5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1217 microversion: 2.1 time: 0.085336 Jan 29 03:46:26.702198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 170/335] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:26 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:26.707152 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:26.707820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:26.714505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.715021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.715884 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.716391 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.866787 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:26.875727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:26.877295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:26.878501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e179784f-6777-4e66-bae7-9e12e1063526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.174708 Jan 29 03:46:26.879131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 171/336] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:26 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:26.888776 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:26.889380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:26.896023 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.896463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:26.897266 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:26.897693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:27.037626 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:27.045156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f6b41030-a95f-4194-aa48-5fda5dcfdcbe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.165179 Jan 29 03:46:27.045716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 172/337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:26 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:27.374887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1c1d44fa-c77d-41fa-8928-695999917a0b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891178 Jan 29 03:46:27.375513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 166/338] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:26 2022] POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:46:27.718696 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:27.719299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:27.725559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:27.725990 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:27.726794 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:27.727218 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:27.788322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:27.795833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-73364d95-f849-4e9f-b576-fd74c3402396 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1221 microversion: 2.1 time: 0.081074 Jan 29 03:46:27.796392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 173/339] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:27 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:27.897535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:27.898191 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:27.904264 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:27.904710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:27.905508 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:27.905938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.042536 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.049484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.050992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.052111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f8c63ac3-2006-4553-bca8-4ee1842ef6f5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.159428 Jan 29 03:46:28.052656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 167/340] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:27 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:28.062744 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:28.063347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:28.069202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.069652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.070456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.070899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.212615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.220289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fb666747-f231-4f44-ac4d-7b871e1e4b42 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1500 microversion: 2.1 time: 0.161124 Jan 29 03:46:28.221549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 174/341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:28 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:28.244161 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "608e5680-3279-4215-9e83-e208af4f1ff5"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:28.245236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:28.251657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.252291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.254783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.254783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.278428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] HTTP exception thrown: Cannot 'attach_volume' instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 while it is in vm_state rescued Jan 29 03:46:28.279058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Returning 409 to user: Cannot 'attach_volume' instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 while it is in vm_state rescued {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:46:28.279869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-572f3b40-4e49-4bb1-9027-03736dbbf470 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042130 Jan 29 03:46:28.280405 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 168/342] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:28 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 29 03:46:28.289345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:28.293458 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:28.296014 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.296456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.297299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.297726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.493927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3cca14ce-cf94-4286-b222-d12f3d35f252 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action" status: 202 len: 0 microversion: 2.1 time: 0.208027 Jan 29 03:46:28.494830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 175/343] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:46:28 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:46:28.503422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:28.504021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:28.509881 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.510364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.511140 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.511578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.664199 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.672030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ba192fd2-1405-4542-90d9-8a3bb65af3c1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1508 microversion: 2.1 time: 0.172108 Jan 29 03:46:28.673063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 169/344] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:28 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:28.813236 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:28.813913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:28.820347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.825163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.825163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:28.825163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:28.914935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:28.923391 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7089df94-d8ed-4b62-ab10-2dd61d4d13d4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1269 microversion: 2.1 time: 0.114197 Jan 29 03:46:28.924065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 176/345] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:28 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:29.071382 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:29.071957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:29.078148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.078610 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:29.079385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.079865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:29.218384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:29.227181 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:29.228666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:29.229813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-13a14b76-7f59-4de1-af16-251621fff757 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.162522 Jan 29 03:46:29.230406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 170/346] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:29 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:29.688808 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:29.689919 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:29.696221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.696927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:29.697719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.698173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:29.860278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:29.867759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-29969490-88f1-4201-a4f5-a53bfbc9958a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1508 microversion: 2.1 time: 0.182596 Jan 29 03:46:29.871831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:29 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:29.940235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:29.951515 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:29.952462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.953213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:29.955496 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:29.956091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:30.100712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:30.108143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ebf9c07c-11b6-4bf6-810b-c8968cc46822 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.171989 Jan 29 03:46:30.108641 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 171/348] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:29 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:30.247896 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:30.248813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:30.259201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:30.259652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:30.260632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:30.261067 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:30.509913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:30.517672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:30.519199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:30.520595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a71a6250-7e90-48da-ad1a-04b2a71f7ed0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.276474 Jan 29 03:46:30.521153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 178/349] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:30 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:30.885486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:30.886087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:30.891817 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:30.892782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:30.893533 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:30.893961 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.018200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-e6d79065-a24d-497a-956d-83fb08a16467 req-8d83864c-d18c-4a6b-bcab-f226eec1f523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981", "tag": "2440b3be-9f8f-4310-96a9-6687885fac5d"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:31.020777 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:46:31.020777 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:46:31.037484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-e6d79065-a24d-497a-956d-83fb08a16467 req-8d83864c-d18c-4a6b-bcab-f226eec1f523 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:31.038155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-e6d79065-a24d-497a-956d-83fb08a16467 req-8d83864c-d18c-4a6b-bcab-f226eec1f523 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.039638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:31.047690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5cf5ce9c-54c5-450a-a5f9-a3d389a2150c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1508 microversion: 2.1 time: 0.165696 Jan 29 03:46:31.048289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 172/350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:30 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:31.051524 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-e6d79065-a24d-497a-956d-83fb08a16467 req-8d83864c-d18c-4a6b-bcab-f226eec1f523 service nova] Creating event network-changed:2440b3be-9f8f-4310-96a9-6687885fac5d for instance dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 on hv-cinder-82694 Jan 29 03:46:31.056885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-e6d79065-a24d-497a-956d-83fb08a16467 req-8d83864c-d18c-4a6b-bcab-f226eec1f523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043038 Jan 29 03:46:31.057862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 179/351] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:31.131985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:31.132438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:31.138523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:31.139230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.139918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:31.140351 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.286672 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:31.294256 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1a8f1d54-2539-42dc-b2b5-e073e22e96cf tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.166355 Jan 29 03:46:31.294824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 173/352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:31 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:31.539557 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:31.540241 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:31.546344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:31.546795 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.547615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:31.548048 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:31.725885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:31.734365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:31.736132 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:31.737448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f23dbfb7-25d6-4dd9-861a-6140be399f8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.201885 Jan 29 03:46:31.738285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 180/353] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:31 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:32.065139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:32.065737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:32.071640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.072089 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.072866 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.073299 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.205411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:32.212898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c5747b62-a437-449c-a981-b5ce2b5449b7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1514 microversion: 2.1 time: 0.151983 Jan 29 03:46:32.213481 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 174/354] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:32 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:32.311387 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:32.311980 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:32.318948 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.319377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.320244 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.320672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.456357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:32.465425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-254da6fb-80c0-4908-94be-6cfe7399b9a4 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.156010 Jan 29 03:46:32.465425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 181/355] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:32 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:32.755811 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:32.756546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:32.762624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.763066 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.763830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:32.764255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:32.899788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:32.908189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:32.911828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:32.911828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2ec406f3-1df3-439b-99d4-e8bd0e785ad8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.159083 Jan 29 03:46:32.911828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 175/356] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:32 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:33.480520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:33.481137 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:33.487451 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.487895 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:33.488669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.489101 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:33.621552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:33.629825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3de112ec-da52-43ae-a107-81ee94764cd6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.152920 Jan 29 03:46:33.630505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 182/357] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:33 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:33.928905 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:33.929505 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:33.937869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.937869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:33.937869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.937869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:33.988219 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:33.989551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:33.996099 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.996593 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:33.997366 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:33.997963 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:34.085972 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:34.094950 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:34.097197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:34.098600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5101bdaa-e78b-49c0-8014-81572f18f12a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.173248 Jan 29 03:46:34.099227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 176/358] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:33 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:34.141137 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:34.148636 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-699f3cb7-2640-4ff1-9139-347f56170897 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1514 microversion: 2.1 time: 0.164556 Jan 29 03:46:34.149201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 183/359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:33 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:34.165264 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5019aa14-5644-4167-9c6c-9cca7783b241"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:34.166611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:34.172869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:34.173118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:34.174594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:34.175096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:34.648482 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:34.649083 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:34.656271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:34.656715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:34.658671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:34.659134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:34.828486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:34.836541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-67d9f1a1-b1a6-4891-b2eb-fcdde5348220 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.193352 Jan 29 03:46:34.837106 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 184/360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:34 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:35.020468 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b5267741-14b8-4827-8607-c508d59c0cfa tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858579 Jan 29 03:46:35.021139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 177/361] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:34 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:35.116036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:35.116971 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:35.123638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:35.124034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:35.125050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:35.125386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:35.293527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:35.300054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:35.301538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:35.302711 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ff01758a-ec39-4bca-904c-d4dcf84c4b81 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.190711 Jan 29 03:46:35.313338 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 185/362] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:35 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:35.855126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:35.856067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:35.862667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:35.865770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:35.865770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:35.865770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:35.926178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2454e96b-596f-4d4b-9b2f-2c798ac0a87e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:35.932687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2454e96b-596f-4d4b-9b2f-2c798ac0a87e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:35.933257 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2454e96b-596f-4d4b-9b2f-2c798ac0a87e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:35.994587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2454e96b-596f-4d4b-9b2f-2c798ac0a87e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Going to try to stop instance {{(pid=123254) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 29 03:46:36.002336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:36.009932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cb84274e-cd60-4f1f-b55c-9b72ff9b033d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.159563 Jan 29 03:46:36.010518 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 178/363] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:35 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:36.180089 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2454e96b-596f-4d4b-9b2f-2c798ac0a87e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action" status: 202 len: 0 microversion: 2.1 time: 0.257526 Jan 29 03:46:36.180791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 186/364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:46:35 2022] POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:46:36.188702 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:36.189304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:36.195301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:36.195750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:36.196876 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:36.197315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:36.321393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:36.322077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:36.328134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:36.328574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:36.329853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:36.330481 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:36.335267 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:36.343013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e581765e-54ba-4dff-80f3-d511f69509b3 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.157971 Jan 29 03:46:36.343572 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 179/365] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:36 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:36.470348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:36.478422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:36.479908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:36.481038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b1207f9d-7886-4805-84c5-b6d73a9019c1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.163923 Jan 29 03:46:36.481723 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 187/366] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:36 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:37.026656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:37.027249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:37.034102 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.034570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.035323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.035748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.169998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:37.177410 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0a6ee460-1d18-4b0e-81f7-6197d3e43fa5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.154343 Jan 29 03:46:37.177902 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 180/367] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:37 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:37.360240 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:37.360932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:37.367385 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.367739 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.368518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.368956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.499004 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:37.499720 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:37.500543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:37.506311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.506755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.507715 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:37.508144 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:37.510206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-da3ca18f-9ee2-4002-b0ed-44ef221ebf9a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.153391 Jan 29 03:46:37.517639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 188/368] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:37 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:37.648044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:37.657157 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:37.658705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:37.660425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b3ab7ea1-a660-4ebb-82d8-2aac840f9b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.164965 Jan 29 03:46:37.660996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 181/369] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:37 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:38.193634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:38.194376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:38.200491 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.200803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.201865 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.202447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.370421 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:38.379237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bd936456-3060-4eb5-98fb-87b91ad090e5 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.187829 Jan 29 03:46:38.379237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 189/370] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:38 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:38.528244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:38.528863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:38.535676 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.536123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.536949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.537356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.639147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-359e5898-5457-4f4f-8b89-e5d51308e96f req-4e34ee67-5c82-4dd0-b735-c6b4d2c25d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981", "name": "network-vif-plugged", "status": "completed", "tag": "2440b3be-9f8f-4310-96a9-6687885fac5d"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:38.640856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:46:38.640856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:46:38.649052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-359e5898-5457-4f4f-8b89-e5d51308e96f req-4e34ee67-5c82-4dd0-b735-c6b4d2c25d0a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.657080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-359e5898-5457-4f4f-8b89-e5d51308e96f req-4e34ee67-5c82-4dd0-b735-c6b4d2c25d0a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.660177 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-359e5898-5457-4f4f-8b89-e5d51308e96f req-4e34ee67-5c82-4dd0-b735-c6b4d2c25d0a service nova] Creating event network-vif-plugged:2440b3be-9f8f-4310-96a9-6687885fac5d for instance dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 on hv-cinder-82694 Jan 29 03:46:38.665005 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-359e5898-5457-4f4f-8b89-e5d51308e96f req-4e34ee67-5c82-4dd0-b735-c6b4d2c25d0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029605 Jan 29 03:46:38.665592 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 190/371] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:46:38.678712 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:38.679419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:38.685531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.685978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.692326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:38.692326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:38.737786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:38.747006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0008c785-30fa-4b23-a6a6-76381e3182ae tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.222663 Jan 29 03:46:38.747583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 182/372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:38 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:38.842743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:38.850566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:38.852059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:38.853203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cf5fe878-f2cd-4fe4-bcbf-923a4eb88229 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.178479 Jan 29 03:46:38.853754 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 191/373] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:38 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:39.393750 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:39.394381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:39.400330 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.400775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.401538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.401969 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.532888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:39.541100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-735b41b4-541e-44d5-a584-690a3dcfad0c tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.150905 Jan 29 03:46:39.541930 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 183/374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:39 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:39.764560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:39.765968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:39.772936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.773377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.789597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.789597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.870743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:39.871361 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:39.877029 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.877482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.878289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:39.878727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:39.951566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:39.959991 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5eb43002-5399-4fce-a1b6-ad20a0b3996d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.199154 Jan 29 03:46:39.960551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 192/375] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:39 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:40.016961 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:40.025732 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:40.027610 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:40.028745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e3fac9fa-9c60-4e5e-b4c3-b8a760bdca6c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.161735 Jan 29 03:46:40.029286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 184/376] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:39 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:40.558017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:40.558660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:40.564497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:40.564945 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:40.566337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:40.566772 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:40.713959 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:40.721197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c09537d7-3627-4776-9592-7470566a4322 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1317 microversion: 2.1 time: 0.166777 Jan 29 03:46:40.721762 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 193/377] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:40 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:40.977163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:40.977769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:40.983949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:40.984393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:40.985167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:40.985597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:41.046481 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:41.047074 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:41.054380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:41.055021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:41.055985 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:41.056414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:41.139227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:41.147805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7f769700-bdd2-4a39-95ee-66a5a1831b87 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.174185 Jan 29 03:46:41.149269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 185/378] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:40 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:41.196065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:41.203912 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:41.205415 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:41.207104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-91e986f6-bc95-43a7-9393-07bdf0ae0526 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.164316 Jan 29 03:46:41.207656 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 194/379] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:41 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:41.736513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:41.737109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:41.743400 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:41.743839 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:41.744596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:41.745022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:41.877362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:41.885049 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7b6732a4-17d4-45d2-a189-cc9f8dff5255 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1508 microversion: 2.1 time: 0.152187 Jan 29 03:46:41.885607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 186/380] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:41 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:42.166468 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:42.167139 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:42.174024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:42.174511 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:42.175293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:42.175725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:42.229125 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:42.229125 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:42.232645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:42.233093 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:42.233876 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:42.234337 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:42.311216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:42.320068 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a684693e-c502-4e28-af57-e51fef60e3af tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.157275 Jan 29 03:46:42.320724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 195/381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:42 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:42.379452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:42.387387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:42.388953 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:42.390119 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e5764d8f-9d8d-4078-956f-99d3d7375d19 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1745 microversion: 2.20 time: 0.168736 Jan 29 03:46:42.390897 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 187/382] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:42 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:43.337030 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:43.337632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:43.344089 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.344543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.345311 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.345742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.408395 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:43.408974 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:43.415252 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.415698 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.416490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.416917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.559356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:43.572717 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:43.574557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:43.575964 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-20573a1a-72c1-4d5c-9650-66a982333087 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1745 microversion: 2.20 time: 0.171341 Jan 29 03:46:43.576731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 188/383] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:43 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:43.632799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:43.633790 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:43.639860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.640302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.641069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:43.641494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:43.665544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'flavor' on Instance uuid 333eec8c-4437-4fe4-9440-e0210b9b6b71 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:46:43.703717 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:43.719086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cd9e8c0b-52f8-4b44-af6f-f11b210d3edf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.385644 Jan 29 03:46:43.719647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 196/384] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:43 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:43.992006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e92319c-c803-418d-b2a7-833c18385bab tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action" status: 200 len: 32 microversion: 2.1 time: 0.363587 Jan 29 03:46:43.992627 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 189/385] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:46:43 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 29 03:46:44.001930 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:44.002572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:44.008521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.008969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.009745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.010200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.170059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:44.180330 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d8eae9a8-80e5-4ea4-8797-60494956507d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.181970 Jan 29 03:46:44.180742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 197/386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:43 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:44.596232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:44.597018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:44.603642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.604096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.604914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.605740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.622752 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-96d27348-e545-4dcc-ae2c-8885ee27f6ef req-80c7c96d-bb0c-4e4d-b7d2-668da56afbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "name": "network-vif-plugged", "status": "completed", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:44.624408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:46:44.624408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:46:44.634892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-96d27348-e545-4dcc-ae2c-8885ee27f6ef req-80c7c96d-bb0c-4e4d-b7d2-668da56afbf8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.635635 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-96d27348-e545-4dcc-ae2c-8885ee27f6ef req-80c7c96d-bb0c-4e4d-b7d2-668da56afbf8 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.648484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-96d27348-e545-4dcc-ae2c-8885ee27f6ef req-80c7c96d-bb0c-4e4d-b7d2-668da56afbf8 service nova] Creating event network-vif-plugged:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:46:44.653548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-96d27348-e545-4dcc-ae2c-8885ee27f6ef req-80c7c96d-bb0c-4e4d-b7d2-668da56afbf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Jan 29 03:46:44.654154 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 198/387] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:46:44.677669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74d63732-20ca-43f7-bfb4-65d4d0ba2a74"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:44.678852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:44.684843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.685296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.686072 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.686589 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.797133 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:44.806877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:44.809011 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:44.810931 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6e9511be-a701-4efb-b7cd-fd61d192f452 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1745 microversion: 2.20 time: 0.218650 Jan 29 03:46:44.811824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 190/388] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:44 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:44.817409 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:44.818686 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:44.824938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.825384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.826207 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:44.826806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:44.971135 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:44.979978 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e531cf3a-e3de-4cb3-b8b9-9cb358a19068 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.166576 Jan 29 03:46:44.980538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 191/389] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:44 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:45.198495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:45.199084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:45.204861 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:45.205300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:45.206061 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:45.206527 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:45.361519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:45.369968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e0e6e970-8145-4523-a32b-1345019ffcf8 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.175176 Jan 29 03:46:45.370570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 192/390] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:45 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:45.603688 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2cc5c7f8-d9f4-4494-8fbd-51d8d9014934 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "POST /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929962 Jan 29 03:46:45.604626 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 199/391] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:46:44 2022] POST /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:46:45.829982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:45.830763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:45.837964 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:45.838515 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:45.839552 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:45.840051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:45.997968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:45.998994 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:46.005946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:46.010098 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:46.011913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:46.012933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:46.013598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:46.016731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:46.018393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:46.020855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b7f148cb-edb2-4bb9-bec6-35777be8694e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.194682 Jan 29 03:46:46.021411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 193/392] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:45 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:46.163713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:46.172040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d796eea7-a53b-49f4-afbd-3ba7e1199e86 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.178748 Jan 29 03:46:46.181522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 200/393] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:45 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:46.386807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:46.390529 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:46.397701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:46.398193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:46.398984 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:46.399651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:46.561681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:46.574554 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3737b4ea-2ef7-4a67-937d-a3995f08d818 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.191577 Jan 29 03:46:46.575437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 194/394] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:46 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:47.046449 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:47.047153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:47.053943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.054423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.055229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.055707 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.189016 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:47.190303 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:47.200188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.200915 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.201910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.202534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.226169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:47.236624 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:47.240895 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:47.242201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b4469cd9-c586-4811-9145-66b00f4ef1e4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.199519 Jan 29 03:46:47.243179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 201/395] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:47 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:47.382634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:47.394878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bcab3be8-fea9-4715-9970-9d13657e3bd2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.209435 Jan 29 03:46:47.405085 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 195/396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:47 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:47.592577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:47.593178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:47.600158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.601890 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.602012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:47.602450 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:47.795995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:47.804532 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cb5d40a1-5800-48a1-9884-967a204db048 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.216142 Jan 29 03:46:47.805680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 202/397] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:47 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:48.261171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:48.261986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:48.268666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.269155 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:48.270332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.270957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:48.412486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:48.413122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:48.413579 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:48.420100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.420553 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:48.421456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.421888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:48.422027 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:48.423468 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:48.424649 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6953a34e-4271-440d-8f7c-31aaad3e4996 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.167582 Jan 29 03:46:48.425219 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 196/398] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:48 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:48.566419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:48.574246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e9e79647-e52d-470d-be88-69ed1226ac9c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.165468 Jan 29 03:46:48.574819 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 203/399] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:48 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:48.824748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:48.824748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:48.837672 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.838378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:48.839364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:48.839959 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:49.048729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:49.059478 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4c06103c-2db5-4f8a-97d3-eea4c1c0c2f1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.240589 Jan 29 03:46:49.060364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 197/400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:48 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:49.447753 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:49.448901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:49.455780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:49.456252 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:49.457045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:49.457484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:49.593506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:49.594118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:49.600265 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:49.600947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:49.602065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:49.603370 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:49.655893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:49.667597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:49.672615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:49.674661 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-71b5f257-1ae3-4693-8840-5e9b3b635818 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.234439 Jan 29 03:46:49.676559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 204/401] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:49 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:49.806530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:49.815651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-28d7c100-7e3b-428e-aeda-63b6018e74cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.227191 Jan 29 03:46:49.816348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 198/402] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:49 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:50.076774 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:50.077278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:50.083475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.083927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.084715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.085310 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.266813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:50.277493 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-acdae232-a6a9-40c8-96eb-f76012f8b990 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.204417 Jan 29 03:46:50.278436 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 205/403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:50 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:50.694924 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:50.695525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:50.707040 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.707733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.711997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.711997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.837957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:50.840220 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:50.858932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.859667 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.863408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:50.864556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:50.931977 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:50.943046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:50.945079 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:50.946774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-39f4259f-82ec-462d-83a9-f34c315f7b13 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.255844 Jan 29 03:46:50.951935 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 199/404] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:50 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:51.048411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:51.057215 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-181d3e1e-59b8-49f6-9c8e-3c52b185d1cf tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.228350 Jan 29 03:46:51.057855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 206/405] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:50 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:51.294479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:51.295530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:51.303479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:51.307141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:51.307141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:51.307141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:51.494664 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:51.503139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c48d1499-fa8b-4bbc-a53f-c53380abaab6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.212153 Jan 29 03:46:51.512976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 200/406] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:51 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:51.977168 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:51.977796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:51.984127 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:51.984579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:51.985353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:51.985780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:52.076477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:52.077095 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:52.084088 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:52.084195 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:52.084886 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:52.085314 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:52.135388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:52.143653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:52.146191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:52.147338 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2a81d8cd-13c2-482b-978c-77f153e4112c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.173959 Jan 29 03:46:52.148546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 207/407] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:51 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:52.219074 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:52.227344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e0a223cc-d4f7-4135-8173-d03345ba0c5c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.154598 Jan 29 03:46:52.230480 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 201/408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:52 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:52.521092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:52.521898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:52.531038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:52.531769 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:52.532478 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:52.532743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:52.719472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:52.719472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4079a59d-16f9-4427-be73-82bf2f0d7661 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.202269 Jan 29 03:46:52.719672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 208/409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:52 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:53.165803 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:53.167295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:53.173451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.173895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.174695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.175358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.245036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:53.245846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:53.267275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.267732 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.268543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.268976 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.367154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:53.379064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:53.382059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:53.382059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-590d896a-3728-4ee3-b674-db23ef4d02fc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.219978 Jan 29 03:46:53.384278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 202/410] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:53 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:53.472665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:53.481958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1af0c772-32a6-415e-92fa-eb8d8df51741 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.240734 Jan 29 03:46:53.482579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 209/411] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:53 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:53.736320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:53.737080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:53.754538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.756318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.757313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:53.757976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:53.929530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:53.946415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6cb51362-d96b-48aa-80c3-46ab63ee2edb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.210067 Jan 29 03:46:53.946415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 203/412] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:53 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:54.401222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:54.401888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:54.408555 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.409086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:54.409921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.410967 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:54.499569 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:54.500261 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:54.509907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.511036 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:54.512015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.512600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:54.580620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:54.592083 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:54.594275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:54.595935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-658f1bca-b350-45e9-a360-5eefa98f91cf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.198465 Jan 29 03:46:54.608041 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 210/413] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:54 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:54.691790 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:54.705812 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-055df6f3-5b8e-4553-8229-d3ef2a2283a7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.210087 Jan 29 03:46:54.707428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 204/414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:54 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:54.961308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:54.961949 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:54.968179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.968621 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:54.969413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:54.969846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.151269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:55.161211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7647edb8-3f48-4fde-8203-e6a4a5b22c48 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.204090 Jan 29 03:46:55.161991 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 211/415] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:54 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:55.225718 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:55.226150 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:55.231966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.234442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.234442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.234442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.310111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'services' on Instance uuid dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:46:55.615316 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:55.616791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:55.623071 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.623725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.624674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.625294 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.643802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3ddbd1eb-0c52-4565-b684-9703bf34ae31 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments/74d63732-20ca-43f7-bfb4-65d4d0ba2a74" status: 202 len: 0 microversion: 2.1 time: 0.421588 Jan 29 03:46:55.646264 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 205/416] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:46:55 2022] DELETE /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments/74d63732-20ca-43f7-bfb4-65d4d0ba2a74 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:46:55.684695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:55.686747 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:55.694292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.694993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.696123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.696701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.748996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-27d4c7c6-d6d1-47b1-9916-97f49489192f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089061 Jan 29 03:46:55.753587 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 206/417] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:55 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:55.758636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:55.759229 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:55.769336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.770644 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.771459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:55.771868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:55.914412 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:55.922746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:55.927070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:55.932643 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b69b3e63-c95e-4dac-a383-0fb11050b112 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.321792 Jan 29 03:46:55.947133 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 212/418] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:55 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:56.003932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:56.016221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-352bffe1-e78c-4497-9f52-b956acfe33f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1724 microversion: 2.1 time: 0.261114 Jan 29 03:46:56.016892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 207/419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:55 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:56.177411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:56.178063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:56.184325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.185069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:56.186022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.186628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:56.374784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:56.382457 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f25181f9-cfdb-41d0-a95e-ad68a1e1b830 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.208869 Jan 29 03:46:56.383017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 213/420] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:56 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:56.760292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:56.761198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:56.767692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.768222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:56.768913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.769360 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:56.799787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-75c3e1cd-1fa4-4315-9501-641d2fe66e25 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Jan 29 03:46:56.804243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 208/421] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:56 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:46:56.954748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:56.957949 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:56.966213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.966667 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:56.967547 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:56.968050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.033606 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:57.034338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:57.041192 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.041642 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.042441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.042877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.119340 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.127284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.129598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.135901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b21869dd-1821-4167-b396-d10ee5045304 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1740 microversion: 2.20 time: 0.184972 Jan 29 03:46:57.136693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 214/422] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:56 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:57.191679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.200096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-beaa6a32-5164-4cd8-b859-4a4bb94e3bde tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1701 microversion: 2.1 time: 0.170160 Jan 29 03:46:57.200660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:57 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:57.217656 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f0186092-b82f-41ea-a06b-eb27d30f08e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:46:57.224123 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f0186092-b82f-41ea-a06b-eb27d30f08e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.224570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f0186092-b82f-41ea-a06b-eb27d30f08e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.248397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f0186092-b82f-41ea-a06b-eb27d30f08e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Going to try to start instance {{(pid=123254) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 29 03:46:57.400085 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:57.400697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:57.406436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.406929 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.407663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.408098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.447525 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f0186092-b82f-41ea-a06b-eb27d30f08e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action" status: 202 len: 0 microversion: 2.1 time: 0.233379 Jan 29 03:46:57.448147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 215/424] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:46:57 2022] POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:46:57.457691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:57.458562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:57.465292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.465969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.466775 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.467384 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.578234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.586922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5c9c0228-a17d-4cb1-b7c8-3f8c7bc6f113 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.191001 Jan 29 03:46:57.597178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 210/425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:57 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:57.626311 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:57.634550 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b8a73331-884e-4aea-ad47-f0e723e7b224 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1710 microversion: 2.1 time: 0.181814 Jan 29 03:46:57.635107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 216/426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:57 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:57.812324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:57.814045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:57.821796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.822629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.823421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:57.824148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:57.861295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-dd9ce248-1a81-43b4-9229-0ee321408ed6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053238 Jan 29 03:46:57.861868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 211/427] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:46:57 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:46:58.155413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:58.156012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:58.167609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.168480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.170219 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.171390 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.475606 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:58.484173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:58.485800 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:58.487104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-24b0f12e-75f9-4b1e-8b8a-ad8d32d7b1b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1722 microversion: 2.20 time: 0.335332 Jan 29 03:46:58.487983 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 217/428] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:58 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:46:58.604510 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:58.605448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:58.611730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.612497 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.614385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.614823 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.652961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:58.653686 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:58.660665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.664262 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.686028 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:58.687422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:58.777315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:58.787076 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8c9cd693-b2a9-421f-a8e6-0e9af0d1b9dc tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.186713 Jan 29 03:46:58.787654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 212/429] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:58 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:46:58.852889 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:58.860720 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6c75bc67-e2fa-4d72-8c17-7f16db20fc2f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1710 microversion: 2.1 time: 0.212625 Jan 29 03:46:58.861208 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 218/430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:58 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:59.230756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:59.231233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:59.237296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.237734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.239164 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.239759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.272666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:46:59.509407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:59.510005 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:59.517012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.517461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.518392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.519003 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.604738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-83b28241-669a-4df1-b163-8303e9d01160 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 204 len: 0 microversion: 2.1 time: 0.382400 Jan 29 03:46:59.605336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 213/431] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:46:59 2022] DELETE /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:46:59.622094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:59.622094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:59.622094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.622663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.623523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.624030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.671394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:59.679987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:59.681521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:59.682995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0177cfc8-3f48-4f03-b10a-877c8813cd32 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1722 microversion: 2.20 time: 0.178321 Jan 29 03:46:59.683646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 219/432] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:46:59 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:46:59.766925 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:59.775129 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-97268764-6c95-4aa7-9161-f871d884ffbb tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1514 microversion: 2.1 time: 0.164961 Jan 29 03:46:59.779606 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 214/433] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:59 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:46:59.804365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:59.804989 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:59.810693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.811700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.811873 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.812299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.877862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:46:59.878293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:46:59.887149 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.887596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.888471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:46:59.888898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:46:59.961452 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:46:59.970091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-04079991-1fd5-42b5-b9f9-4b10797d1110 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.170024 Jan 29 03:46:59.970887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 220/434] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:59 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:00.036051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:00.043824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-dd6ed631-5edc-4da9-93ba-d0af7d37830c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1714 microversion: 2.1 time: 0.169822 Jan 29 03:47:00.044391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 215/435] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:46:59 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1714 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:00.658660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-891e0f2c-a1f6-4352-8cc8-a9528c8ec55e req-c303f15d-019c-42bf-8009-c513d79d86bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "name": "network-vif-unplugged", "status": "completed", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:00.664721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:00.664721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:47:00.681205 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-891e0f2c-a1f6-4352-8cc8-a9528c8ec55e req-c303f15d-019c-42bf-8009-c513d79d86bd service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.681684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-891e0f2c-a1f6-4352-8cc8-a9528c8ec55e req-c303f15d-019c-42bf-8009-c513d79d86bd service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.693369 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-891e0f2c-a1f6-4352-8cc8-a9528c8ec55e req-c303f15d-019c-42bf-8009-c513d79d86bd service nova] Creating event network-vif-unplugged:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:47:00.698398 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-891e0f2c-a1f6-4352-8cc8-a9528c8ec55e req-c303f15d-019c-42bf-8009-c513d79d86bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043225 Jan 29 03:47:00.698981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 221/436] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:00.701034 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:00.701651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:00.708368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.708878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.710136 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.710804 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.795642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:00.797059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:00.814344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.815012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.815960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.817001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.853278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:00.861464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:00.862982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:00.864654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8d963967-139b-4b09-b8ca-346a603800ab tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1722 microversion: 2.20 time: 0.167713 Jan 29 03:47:00.865210 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 216/437] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:00 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:47:00.961585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:00.968697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0541cda1-b2c7-4a57-831f-ca35c6cc6699 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1514 microversion: 2.1 time: 0.177255 Jan 29 03:47:00.969255 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 222/438] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:00 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:00.987481 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:00.988118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:00.993840 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.994334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:00.995112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:00.995599 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:01.127209 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:01.135772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e372abf-6619-418f-b654-ec64880bd28e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.151852 Jan 29 03:47:01.136341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 217/439] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:00 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:01.882542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:01.883070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:01.889153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:01.889597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:01.890395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:01.890829 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:01.985706 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:01.986335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:01.993144 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:01.993566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:01.994352 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:01.994779 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:02.026625 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:02.034678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:02.036679 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:02.037814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f495587b-5f32-4a57-bff6-41d49739a5db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1725 microversion: 2.20 time: 0.159040 Jan 29 03:47:02.038399 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 223/440] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:01 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:02.056872 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63dad7e6-f7db-422c-85d3-7a3672f98c92"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:02.058152 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:02.064274 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:02.064907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:02.065777 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:02.066364 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:02.133319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:02.140715 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-df2dde9d-ac79-45c6-abe7-5675a7c14b34 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1514 microversion: 2.1 time: 0.158536 Jan 29 03:47:02.141277 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 218/441] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:01 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:02.154297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:02.154886 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:02.161158 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:02.161597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:02.162383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:02.162810 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:02.311227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:02.319436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a08f9d64-8869-4d33-8e90-80a055ff7609 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.168777 Jan 29 03:47:02.320008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 219/442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:02 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:03.047099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-524e37f1-f38a-4616-a4f9-2ebf33b19973 req-ccc6ace3-ab76-4257-a5c4-a28a6bbfd370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981", "name": "network-vif-deleted", "tag": "2440b3be-9f8f-4310-96a9-6687885fac5d"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:03.048786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:03.048786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:03.057174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-524e37f1-f38a-4616-a4f9-2ebf33b19973 req-ccc6ace3-ab76-4257-a5c4-a28a6bbfd370 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.057702 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-524e37f1-f38a-4616-a4f9-2ebf33b19973 req-ccc6ace3-ab76-4257-a5c4-a28a6bbfd370 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.069486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-524e37f1-f38a-4616-a4f9-2ebf33b19973 req-ccc6ace3-ab76-4257-a5c4-a28a6bbfd370 service nova] Creating event network-vif-deleted:2440b3be-9f8f-4310-96a9-6687885fac5d for instance dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 on hv-cinder-82694 Jan 29 03:47:03.074404 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-524e37f1-f38a-4616-a4f9-2ebf33b19973 req-ccc6ace3-ab76-4257-a5c4-a28a6bbfd370 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Jan 29 03:47:03.074998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 220/443] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:47:03.158056 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:03.158815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:03.164884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.165341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.166113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.166624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.228389 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:03.236279 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4d75a81a-c9d5-49ef-b74a-08e80cdd1d9e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1472 microversion: 2.1 time: 0.082136 Jan 29 03:47:03.237224 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 221/444] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:03 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:03.307259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fc1ff6ee-2c05-4e09-b179-6c3270338c08 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.255113 Jan 29 03:47:03.312323 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 224/445] 10.222.0.16 () {62 vars in 1363 bytes} [Sat Jan 29 03:47:02 2022] POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments => generated 188 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 29 03:47:03.335990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:03.336654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:03.342698 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.343202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.344024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.344512 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.420379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:03.420908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:03.427971 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.428446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.429259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.429699 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.497276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:03.505180 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cb5eca6d-8da5-4ae2-beec-8e2794e47b6a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.173029 Jan 29 03:47:03.506388 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 222/446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:03 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:03.652599 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c12484c1-d9db-46cb-906d-69118b3db6e0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/action" status: 202 len: 0 microversion: 2.20 time: 0.236004 Jan 29 03:47:03.653211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 225/447] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Jan 29 03:47:03 2022] POST /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 29 03:47:03.661700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:03.662335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:03.668128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.668566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.669877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:03.669877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:03.800153 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:03.808410 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:03.809907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:03.815020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-84f7c310-a154-46f9-bd13-d2c742380f72 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1751 microversion: 2.20 time: 0.153669 Jan 29 03:47:03.815020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 223/448] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:03 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:04.255132 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:04.255734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:04.262308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.262828 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.263814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.264336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.297037 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.297488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.297933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'fault' on Instance uuid dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:04.340303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:04.346903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d15ed1c1-9d5d-45e1-9340-96894a899bef tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 200 len: 1307 microversion: 2.1 time: 0.096776 Jan 29 03:47:04.347474 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 226/449] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:04 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:04.522704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:04.523313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:04.529756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.530289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.531092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.531558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.684597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:04.692494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-210bd72c-580f-4cc3-aa01-78c395cc8e1a tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.173731 Jan 29 03:47:04.693254 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 224/450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:04 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:04.829055 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:04.829662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:04.836325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.836771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.837542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:04.837979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:04.982672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:04.990802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:04.992280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:04.993405 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3ce5c231-7cc9-435c-8029-2a75b728e247 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1751 microversion: 2.20 time: 0.168574 Jan 29 03:47:04.993962 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 227/451] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:04 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:05.362754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:05.363794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:05.369434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:05.372013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:05.372013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:05.372013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:05.384743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Instance dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 could not be found. Jan 29 03:47:05.385313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 404 to user: Instance dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:05.386132 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b11d3c70-7d07-4155-91c5-9254026d8c2b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981" status: 404 len: 111 microversion: 2.1 time: 0.027133 Jan 29 03:47:05.386659 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 225/452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:05 2022] GET /compute/v2.1/servers/dc4a2fa3-1cd9-4487-9eb3-2fb1d9e15981 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:05.709903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:05.710597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:05.717224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:05.717672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:05.718487 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:05.718924 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:05.854996 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:05.862765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-51324179-3adb-4e3f-ac34-b377e374d150 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.156440 Jan 29 03:47:05.863944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 228/453] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:05 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:06.011906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:06.012500 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:06.018602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.019045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.020310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.020734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.154760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:06.163632 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:06.165101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:06.166459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6ce86c36-3e63-49cb-92a7-a87b9830b460 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1753 microversion: 2.20 time: 0.158209 Jan 29 03:47:06.167009 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 226/454] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:06 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:06.675176 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:06.676182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:06.681961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.682436 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.683448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.683857 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.708474 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:06.880620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:06.881350 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:06.887491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.887933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.888885 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.889312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.936373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5305647a-4140-49b4-8ac8-9b3f039311cd tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 204 len: 0 microversion: 2.1 time: 0.264466 Jan 29 03:47:06.937118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 229/455] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:06 2022] DELETE /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:47:06.945963 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:06.946723 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:06.954121 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.954619 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:06.955403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:06.955840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:07.030021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:07.038491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-722c1065-02ee-45bf-93ea-28f3f1399b72 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.161921 Jan 29 03:47:07.039098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 227/456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:06 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:07.094956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:07.102748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e90953c3-51f5-4141-a33e-ba380f33eb24 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1514 microversion: 2.1 time: 0.161490 Jan 29 03:47:07.103313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:06 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:07.184990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:07.185539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:07.191824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:07.194586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:07.194586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:07.194586 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:07.326448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:07.335333 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:07.336809 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:07.337984 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1a269f7b-42ff-430b-b046-d63e523a57ef tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1753 microversion: 2.20 time: 0.156781 Jan 29 03:47:07.338594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 228/458] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:07 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:08.055316 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:08.055936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:08.062685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.063141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.063940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.064378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.119502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:08.120109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:08.126646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.127096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.127947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.128318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.283765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:08.291418 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-235562f7-e4a3-48b8-a6e0-251814689344 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1514 microversion: 2.1 time: 0.175518 Jan 29 03:47:08.292170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 229/459] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:08 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:08.344532 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:08.353050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4aa54e17-5a38-441c-906e-ae99d008200d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.301437 Jan 29 03:47:08.353706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 231/460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:08 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:08.356802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:08.357436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:08.363723 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.364167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.364940 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:08.365366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:08.507065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:08.524184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:08.525945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:08.527206 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bfa4699d-1d91-4c6f-9eb0-a4d5d04454b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.174725 Jan 29 03:47:08.527778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 230/461] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:08 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:09.308590 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:09.309232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:09.315534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.315927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.316718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.317738 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.372434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:09.373046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:09.379138 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.380263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.381037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.381461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.515169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:09.538752 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:09.546341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-30c2e01b-4f5a-4e79-b48d-d1483df6e600 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.179344 Jan 29 03:47:09.555743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d2966cf0-435b-49e4-aa40-88e4e7e7940b tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1514 microversion: 2.1 time: 0.250945 Jan 29 03:47:09.577068 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:09 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:09.582148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:09.583412 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:09.586291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 231/463] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:09 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:09.592618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.607844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.609080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.609776 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:09.838855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:09.848620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:09.850483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:09.851892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-36c82181-2476-45bd-bf1d-8b2da20dc6a9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.273735 Jan 29 03:47:09.852539 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 233/464] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:09 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:09.978058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-5ca09c08-42fa-48be-923d-99cc51c0187a req-16e73d19-1dfc-4940-a30e-a1516a3c729c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4648ab-9197-424a-bbd3-154000deff15", "name": "network-vif-deleted", "tag": "a45095a8-11a0-4b26-80eb-17ac9fcbb199"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:09.980118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:09.980118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:09.991618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-5ca09c08-42fa-48be-923d-99cc51c0187a req-16e73d19-1dfc-4940-a30e-a1516a3c729c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:09.995950 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-5ca09c08-42fa-48be-923d-99cc51c0187a req-16e73d19-1dfc-4940-a30e-a1516a3c729c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.008946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-5ca09c08-42fa-48be-923d-99cc51c0187a req-16e73d19-1dfc-4940-a30e-a1516a3c729c service nova] Creating event network-vif-deleted:a45095a8-11a0-4b26-80eb-17ac9fcbb199 for instance 0c4648ab-9197-424a-bbd3-154000deff15 on hv-cinder-82694 Jan 29 03:47:10.015555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-5ca09c08-42fa-48be-923d-99cc51c0187a req-16e73d19-1dfc-4940-a30e-a1516a3c729c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Jan 29 03:47:10.017411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 232/465] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:10.573528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:10.575793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:10.589461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:10.590178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:10.593284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.596376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.597942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.599023 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.602678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.603131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.606348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.607611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.701063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:10.714864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c45a95f0-2156-4f5b-9752-90b89b26d937 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.146011 Jan 29 03:47:10.724709 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 234/466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:10 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:10.869187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:10.869187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-79595775-37cd-48b1-bdb6-4851c61a5490 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.277100 Jan 29 03:47:10.869187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 233/467] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:10 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:10.872419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:10.873213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:10.890547 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.891095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:10.891993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:10.892512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:11.059024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:11.067747 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:11.069288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:11.070500 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f17fcc71-ac55-43c7-a378-50f9203682d8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.203416 Jan 29 03:47:11.074174 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 235/468] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:10 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:47:11.731312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:11.731921 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:11.738420 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:11.739249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:11.740041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:11.740532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:11.805092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:11.812743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3af5956a-f8e6-4a81-918c-69bf15b41741 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.085028 Jan 29 03:47:11.813779 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 234/469] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:11 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:11.886432 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:11.966082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:11.966082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:11.966082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:11.966082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:11.966563 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:12.044527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:12.052719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5b59a6a7-e89f-498c-92d2-002879d8dffe tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.169863 Jan 29 03:47:12.053292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 236/470] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:11 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:12.089486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:12.090090 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:12.096657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:12.097127 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:12.098247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:12.098566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:12.335730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:12.350577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:12.353795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:12.355292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fd090744-bda8-463d-ba66-0d4b04bc28ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.269641 Jan 29 03:47:12.356101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 235/471] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:12 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:12.828715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:12.829330 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:12.836790 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:12.837239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:12.838032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:12.838504 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:12.917336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:12.926078 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dd2d7d6f-159b-465e-9ef3-92332115cc0d tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.100878 Jan 29 03:47:12.937302 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 237/472] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:12 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:13.069148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:13.070031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:13.076638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.077357 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:13.078348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.078952 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:13.235285 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:13.243730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9f863e27-bedf-4afd-9fc1-486a593aba9e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.178414 Jan 29 03:47:13.259336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 236/473] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:13 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:13.374503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:13.381057 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:13.381804 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.382428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:13.383419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.383859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:13.546623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:13.555647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:13.557626 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:13.559041 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d0c48378-6e4d-4ccd-bc50-531eba37620c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.188781 Jan 29 03:47:13.560071 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 238/474] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:13 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:13.946067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:13.947154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:13.954846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.955310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:13.956112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:13.970714 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:14.024288 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:14.032334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-53bdb125-be09-4fc2-b47d-02d6c4cd0568 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.090912 Jan 29 03:47:14.037100 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 237/475] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:13 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:14.262906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:14.264181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:14.270999 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:14.271746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:14.272770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:14.273400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:14.490746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:14.503095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-beba9262-1b5e-43c3-830a-91ed28fa1126 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.245708 Jan 29 03:47:14.510530 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 239/476] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:14 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:14.578524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:14.579199 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:14.586323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:14.586770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:14.587548 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:14.587975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:14.746979 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:14.756808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:14.758413 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:14.759617 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6dfd05c9-bc69-4308-b161-734782567e61 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.185241 Jan 29 03:47:14.760160 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 238/477] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:14 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:15.049671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:15.050240 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:15.056551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.057016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.057821 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.058371 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.126343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:15.135646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b8579b38-42b7-46e8-baf9-c454ab314d47 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.089428 Jan 29 03:47:15.136029 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 240/478] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:15 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:15.521929 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:15.522556 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:15.528400 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.529092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.529869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.530330 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.720233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:15.731148 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-daf9c36b-3ae8-40bb-8741-af8984417884 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.213051 Jan 29 03:47:15.731985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 239/479] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:15 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:15.781169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:15.782898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:15.790820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.791632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.792802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:15.793295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:15.969278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:15.978480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:15.980088 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:15.981273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ae1e8cc2-b7ea-44d4-a114-07140922fa9e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.204977 Jan 29 03:47:15.981833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 241/480] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:15 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:16.208077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:16.208077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:16.208077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:16.208077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:16.208773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:16.208773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:16.224612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:16.234464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-00d0b8d0-4e06-4f09-a2eb-f85b1dd4dcc6 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.085285 Jan 29 03:47:16.240472 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 240/481] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:16 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:16.756105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:16.757077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:16.764681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:16.765548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:16.766597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:16.767266 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:16.920641 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:16.929610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0d50c36e-6b5b-4f06-9f7d-e0539cf8f6e7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.177988 Jan 29 03:47:16.930210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:16 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:17.000488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:17.001102 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:17.008167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.008909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:17.009872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.010389 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:17.180372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:17.190563 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:17.194058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:17.195527 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8a6100be-3f76-4a0e-b5c7-00f0d700f02f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.198771 Jan 29 03:47:17.196483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 241/483] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:16 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:17.251295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:17.252248 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:17.261678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.262625 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:17.263797 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.264495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:17.333337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:17.341573 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-38c1f076-d509-4a52-90ca-bcd3adbc1e1f tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1472 microversion: 2.1 time: 0.093868 Jan 29 03:47:17.351343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 243/484] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:17 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:17.887063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-355477937", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:17.938073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] validate_networks() for None {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:47:17.947807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:17.948623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:17.955284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.955816 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:17.956678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:17.957185 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.121192 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.130038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-39bea8a8-536b-42d6-be83-a4e14949b591 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.186523 Jan 29 03:47:18.141225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 244/485] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:17 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:18.216669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:18.218231 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:18.229817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.229817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.229817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.229817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.244616 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:47:18.245628 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:47:18.245628 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:47:18.246884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:47:18.247242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:47:18.257597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.259191 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.259191 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.259493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.280180 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Getting quotas for project 350b5db208544c64ba32651c83dcb7cd. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:47:18.284454 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Getting quotas for user b9fc0d7cc6d740aaa95e7646e5ab9c34 and project 350b5db208544c64ba32651c83dcb7cd. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:47:18.297000 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:47:18.300140 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:47:18.395956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.404687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.406832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.408597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ae46bac0-5cea-4a15-a633-40804991cba5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.196411 Jan 29 03:47:18.409162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 245/486] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:18 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:47:18.413916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:18.414608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:18.420799 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.421471 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.422652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.423284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.424601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d84b28a2-5baa-4937-8ad7-72572a97d01c tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541036 Jan 29 03:47:18.425399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 242/487] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:47:18.437328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-427bbca9-8abd-43c9-a21a-8333e2b41bc0 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:18.438473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-427bbca9-8abd-43c9-a21a-8333e2b41bc0 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:18.465948 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:18.466421 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:18.468178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'fault' on Instance uuid 0c4648ab-9197-424a-bbd3-154000deff15 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:18.510045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-427bbca9-8abd-43c9-a21a-8333e2b41bc0 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.516811 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-427bbca9-8abd-43c9-a21a-8333e2b41bc0 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1214 microversion: 2.1 time: 0.083447 Jan 29 03:47:18.517504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 243/488] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:18 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:18.524779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:18.533552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0ded0f7d-5a6d-4422-b182-02aef3ac8009 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 200 len: 1308 microversion: 2.1 time: 0.123391 Jan 29 03:47:18.534113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 246/489] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:18 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:19.148415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.149382 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.157493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.158092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.159230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.159669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.304487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:19.313583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-81dbd22a-cea0-4bb6-a8eb-94b4cbceaadb tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.169848 Jan 29 03:47:19.314176 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 244/490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:19 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:19.429303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.429907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.436647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.437092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.437860 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.438323 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.536161 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.536702 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.543068 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.543517 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.544295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.544726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.585569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:19.595055 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:19.596817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:19.598969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e466330d-a300-4a8c-9441-d59e424fa707 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.173189 Jan 29 03:47:19.608948 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 247/491] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:19 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:19.613508 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.614898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: 0c4648ab-9197-424a-bbd3-154000deff15] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.615962 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:19.622914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.623286 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.624076 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.624682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.628300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-40a3162f-2ff1-4138-bd42-eabf39fc4893 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1218 microversion: 2.1 time: 0.096352 Jan 29 03:47:19.629163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 245/492] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:19 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:19.648006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Instance 0c4648ab-9197-424a-bbd3-154000deff15 could not be found. Jan 29 03:47:19.648733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 404 to user: Instance 0c4648ab-9197-424a-bbd3-154000deff15 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:19.649581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fea05806-7008-4086-a099-2d93989f079e tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15" status: 404 len: 111 microversion: 2.1 time: 0.039741 Jan 29 03:47:19.650145 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 248/493] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:19 2022] GET /compute/v2.1/servers/0c4648ab-9197-424a-bbd3-154000deff15 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:19.658162 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.659432 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.665413 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.666149 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.666999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.667430 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.693167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:19.976077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-62034ae6-9eef-489f-b10a-780948295b85 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 204 len: 0 microversion: 2.1 time: 0.321262 Jan 29 03:47:19.976676 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 246/494] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:19 2022] DELETE /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 29 03:47:19.985543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:19.986186 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:19.992571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.993982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:19.993982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:19.994321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.143495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.151480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4488d9bb-11a8-4675-990b-caf4eafe0d64 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1514 microversion: 2.1 time: 0.170442 Jan 29 03:47:20.152060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 249/495] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:19 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:20.331571 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:20.332251 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:20.339471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.344080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.344080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.344080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.484828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.493184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7ceb5a67-8f8f-489e-906b-b382f6026974 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1566 microversion: 2.1 time: 0.165573 Jan 29 03:47:20.493756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 247/496] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:20 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:20.618392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:20.619336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:20.626768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.627219 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.629501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.629501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.645872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:20.652888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:20.652888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.653128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.653853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:20.654330 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:20.728165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.736387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d252a2cf-d8dc-4e08-b66e-eeaf37497368 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1266 microversion: 2.1 time: 0.094994 Jan 29 03:47:20.737112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 248/497] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:20 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:20.810503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.819832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.821343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:20.822522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-67fc4b33-4e4c-46bc-94fc-cb106fc4888d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.208839 Jan 29 03:47:20.823069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 250/498] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:20 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:21.168986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:21.169713 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.176775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.177305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.178312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.178740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.314228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:21.321537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9d6e324d-47b7-46c2-83a1-1b60b7a56337 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1514 microversion: 2.1 time: 0.156229 Jan 29 03:47:21.333636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 249/499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:21 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:21.510038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:21.510865 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.516709 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.517184 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.517965 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.518433 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.753051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:21.753788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.761818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.761818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.762935 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.763236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.771170 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:21.787100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-54c1048a-ea09-4f58-a604-4215fb933dc7 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1546 microversion: 2.1 time: 0.280922 Jan 29 03:47:21.787669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 251/500] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:21 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1546 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:21.810448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:21.811258 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.820117 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.820879 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.821880 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.822537 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.853811 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:21.862916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-086d9dcf-8912-4fad-9582-f71c7fda98a6 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1272 microversion: 2.1 time: 0.113786 Jan 29 03:47:21.863521 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:21 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:21.868765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:21.870484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.878835 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.879818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.880609 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.881037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.910454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] HTTP exception thrown: Cannot 'detach_volume' instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 while it is in vm_state rescued Jan 29 03:47:21.911291 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Returning 409 to user: Cannot 'detach_volume' instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 while it is in vm_state rescued {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:21.913189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c9116969-85ea-4c43-a82d-0c19a61b240c tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments/5019aa14-5644-4167-9c6c-9cca7783b241" status: 409 len: 152 microversion: 2.1 time: 0.107207 Jan 29 03:47:21.913189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:47:21 2022] DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments/5019aa14-5644-4167-9c6c-9cca7783b241 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 29 03:47:21.922549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:21.923173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:21.929465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.930141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:21.931055 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:21.931594 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.158054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fc504770-8378-4d32-be39-70fdfe8e2cad tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action" status: 202 len: 0 microversion: 2.1 time: 0.239189 Jan 29 03:47:22.158990 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 253/503] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:47:21 2022] POST /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:47:22.170165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:22.172232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:22.178957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.179404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.180198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.180623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.276222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:22.286748 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:22.289512 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:22.290993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0e4ae166-80f3-4665-ac6b-6e2cfd622fc4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.426367 Jan 29 03:47:22.291821 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 251/504] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:21 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:22.341140 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:22.341774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:22.350016 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.351404 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.352531 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.353137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.460085 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:22.471435 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2425f60c-43a7-433b-a636-22c32a8af787 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1554 microversion: 2.1 time: 0.306451 Jan 29 03:47:22.472349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 254/505] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:22 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:22.550651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:22.558606 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a1681539-6634-44fb-9317-dbb4b966d8b9 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1514 microversion: 2.1 time: 0.221442 Jan 29 03:47:22.559174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 252/506] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:22 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:22.881311 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:22.881925 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:22.889413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.892822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:22.892822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:22.892822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.147960 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a2dcb266-3fb5-403a-ade2-9fe32a45e874 req-6073d5f1-5504-4940-aa23-907b05d28972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a9257-3fe8-4070-a394-1414e2841f9d", "name": "network-vif-deleted", "tag": "67b0b6c1-cb7b-438f-a2e1-afa6543d4e99"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:23.150030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:23.150030 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:23.161514 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a2dcb266-3fb5-403a-ade2-9fe32a45e874 req-6073d5f1-5504-4940-aa23-907b05d28972 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.162194 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a2dcb266-3fb5-403a-ade2-9fe32a45e874 req-6073d5f1-5504-4940-aa23-907b05d28972 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.174727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a2dcb266-3fb5-403a-ade2-9fe32a45e874 req-6073d5f1-5504-4940-aa23-907b05d28972 service nova] Creating event network-vif-deleted:67b0b6c1-cb7b-438f-a2e1-afa6543d4e99 for instance af9a9257-3fe8-4070-a394-1414e2841f9d on hv-cinder-82694 Jan 29 03:47:23.175574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.182172 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a2dcb266-3fb5-403a-ade2-9fe32a45e874 req-6073d5f1-5504-4940-aa23-907b05d28972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040750 Jan 29 03:47:23.183924 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 253/507] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:23.185024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d4aa07bd-d1ff-4be9-898b-3b0caeec66d8 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.307877 Jan 29 03:47:23.186326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 255/508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:22 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:23.310113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:23.316240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:23.330453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.330966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.333387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.333752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.492788 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:23.493352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:23.494841 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.499883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.504634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.504634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.504634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.505469 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.508354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.509932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c8f613a9-a8aa-4e76-8126-8ddb277205aa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.204708 Jan 29 03:47:23.518393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 254/509] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:23 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:23.575095 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:23.576817 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:23.583229 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.584636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.585445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.585909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.622334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:23.622789 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:23.623430 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'fault' on Instance uuid af9a9257-3fe8-4070-a394-1414e2841f9d {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:23.681949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.690918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9bdc162a-05f3-4261-9a60-cc25e7fa2297 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 200 len: 1308 microversion: 2.1 time: 0.119582 Jan 29 03:47:23.691745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 255/510] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:23 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:23.722427 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:23.731845 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-50350ce7-8499-4453-bb75-62b184d17f00 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1554 microversion: 2.1 time: 0.244820 Jan 29 03:47:23.732439 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 256/511] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:23 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:24.202327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:24.220781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:24.220781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.220781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.220781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.221159 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.342153 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:24.350263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-98cab6fb-fd60-4c66-904f-b783feb66c14 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.151579 Jan 29 03:47:24.363555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 256/512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:24 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:24.528687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:24.529306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:24.536285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.536737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.537520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.537957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.707021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:24.708425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: af9a9257-3fe8-4070-a394-1414e2841f9d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:24.721227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.721807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.723884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.724358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.741218 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Instance af9a9257-3fe8-4070-a394-1414e2841f9d could not be found. Jan 29 03:47:24.746577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 404 to user: Instance af9a9257-3fe8-4070-a394-1414e2841f9d could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:24.746577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-52b65233-0134-4fee-a7f5-21f6c7c2fbf2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d" status: 404 len: 111 microversion: 2.1 time: 0.039384 Jan 29 03:47:24.746577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 257/513] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:24 2022] GET /compute/v2.1/servers/af9a9257-3fe8-4070-a394-1414e2841f9d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 03:47:24.748342 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:24.748948 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:24.755636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.756082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.757855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:24.757855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:24.896689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:24.900342 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:24.905352 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0648c252-caea-41e9-90bd-dc499260f1a0 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1554 microversion: 2.1 time: 0.160163 Jan 29 03:47:24.906236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 258/514] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:24 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:24.909020 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:24.910927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:24.912094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5bfb2b91-69c3-4880-8a3b-6bb7fe0ed50c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.387198 Jan 29 03:47:24.912708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 257/515] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:24 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:25.198381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a57595f3-7922-4122-a194-8c79149b68c0 req-b7aa02f6-8073-4456-a44f-f23c15a8fb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a90a4b-c57e-418b-8212-bb3b6d945c71", "tag": "251d6947-a8c1-4bf3-9996-64aec13dad92"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:25.199963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:25.199963 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:25.208696 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a57595f3-7922-4122-a194-8c79149b68c0 req-b7aa02f6-8073-4456-a44f-f23c15a8fb64 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.209131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a57595f3-7922-4122-a194-8c79149b68c0 req-b7aa02f6-8073-4456-a44f-f23c15a8fb64 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.220092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a57595f3-7922-4122-a194-8c79149b68c0 req-b7aa02f6-8073-4456-a44f-f23c15a8fb64 service nova] Creating event network-changed:251d6947-a8c1-4bf3-9996-64aec13dad92 for instance f7a90a4b-c57e-418b-8212-bb3b6d945c71 on hv-cinder-82694 Jan 29 03:47:25.226157 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a57595f3-7922-4122-a194-8c79149b68c0 req-b7aa02f6-8073-4456-a44f-f23c15a8fb64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031329 Jan 29 03:47:25.226968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 259/516] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:25.366413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:25.367038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:25.373035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.381278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.381278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.381278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.618618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:25.626489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d59b741c-2fec-4c95-9d65-1d30742ea994 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.264199 Jan 29 03:47:25.627063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 258/517] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:25 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:25.922356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:25.923068 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:25.930320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:25.930710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.930933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:25.931169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.931964 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.932405 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.947472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.947925 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:25.948720 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:25.949367 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.089418 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.097318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-855a1ec1-b13d-4818-8ec4-3f581e3d7e8d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1560 microversion: 2.1 time: 0.179032 Jan 29 03:47:26.098182 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 260/518] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:25 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:26.102767 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:26.103271 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:26.109807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.110303 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.111096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.111530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.137581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:26.163595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.173505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.175056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.176292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1d1d1961-bda2-4cb5-9586-57899babfb8b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.250006 Jan 29 03:47:26.177339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 259/519] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:25 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:47:26.182096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:26.182611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:26.190556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.198745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.198745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.198745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.274814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'services' on Instance uuid 333eec8c-4437-4fe4-9440-e0210b9b6b71 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:26.438889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-353c8f99-d42b-4801-ac93-a8a790d53928 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 204 len: 0 microversion: 2.1 time: 0.339253 Jan 29 03:47:26.439523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 261/520] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:26 2022] DELETE /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:47:26.450258 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:26.451134 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:26.456775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.457228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.458045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.458559 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.520768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-454ca9cf-a413-4444-9ce8-11bcf4cc4bb1 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments/5019aa14-5644-4167-9c6c-9cca7783b241" status: 202 len: 0 microversion: 2.1 time: 0.341091 Jan 29 03:47:26.521548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 260/521] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:47:26 2022] DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments/5019aa14-5644-4167-9c6c-9cca7783b241 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:47:26.529833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:26.532988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:26.540607 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.541131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.541937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.542425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.574319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4036299e-7bba-4f69-acde-6f74c311d3b6 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048402 Jan 29 03:47:26.575057 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 261/522] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:47:26 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:47:26.610407 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.619776 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-50f0ba8e-0afa-4303-a64b-35c38258d9c7 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1513 microversion: 2.1 time: 0.175311 Jan 29 03:47:26.620347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 262/523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:26 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:26.643365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:26.643980 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:26.651158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.652300 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.653027 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:26.653591 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:26.797875 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:26.806122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4baea364-ccc2-4d5d-9dff-f6a20c875aa2 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.166297 Jan 29 03:47:26.806919 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 262/524] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:26 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:27.194726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:27.195331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:27.202145 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.202846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.203787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.204220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.359297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:27.371353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:27.373771 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:27.375561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b4306cf0-4fdd-4c8d-ba47-fbd2ed22a0fb tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.184457 Jan 29 03:47:27.376394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 263/525] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:27 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:27.585987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:27.586946 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:27.593215 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.593599 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.594407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.594843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.623933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-71554a2c-870f-40bf-bc93-d33669efc05f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Jan 29 03:47:27.624491 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 263/526] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:47:27 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:27.636306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:27.640648 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:27.642873 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.643321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.644094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.644806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.793661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:27.801972 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5f68c402-3d66-4f70-8d3d-c7f2851ee332 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1513 microversion: 2.1 time: 0.168639 Jan 29 03:47:27.803308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 264/527] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:27 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:27.823103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:27.823712 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:27.829418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.829865 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.830720 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:27.831130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:27.973382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:27.981368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3b6abf13-9f3d-48c6-afdb-cc1748aa3bed tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.161726 Jan 29 03:47:27.981964 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 264/528] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:27 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:28.397107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:28.397702 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:28.404165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.404613 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.405375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.405800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.536304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:28.544656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:28.546170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:28.547319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-71a58874-dd9a-452a-9da0-b4af02912ff5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.154450 Jan 29 03:47:28.547879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 265/529] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:28 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:28.635353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:28.636356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:28.642552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.642993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.643769 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.644194 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.672761 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c9e0a4aa-1b5d-41e3-ae6c-8a28a0db1543 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041192 Jan 29 03:47:28.673318 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 265/530] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:47:28 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:47:28.818990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:28.819581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:28.825511 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.825951 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.826764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:28.827190 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:28.971312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:28.977413 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-73b6e2a5-469c-4b0c-bfb9-88b9bc71209a tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1513 microversion: 2.1 time: 0.162096 Jan 29 03:47:28.977990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 266/531] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:28 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:28.998229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:28.998883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:29.007151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:29.007608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:29.013845 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:29.013845 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:29.046012 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-88911f5a-7e87-447f-85d3-add096cc5532 req-8cd703f2-5c85-4a3c-a953-7fb1b21be99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb51aefd-c927-464c-a843-4291d9f9ec0b", "name": "network-vif-deleted", "tag": "26b58599-e1e8-4de8-a1fd-779b33246181"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:29.047633 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:29.047633 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:29.054697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-88911f5a-7e87-447f-85d3-add096cc5532 req-8cd703f2-5c85-4a3c-a953-7fb1b21be99b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:29.055136 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-88911f5a-7e87-447f-85d3-add096cc5532 req-8cd703f2-5c85-4a3c-a953-7fb1b21be99b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:29.066045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-88911f5a-7e87-447f-85d3-add096cc5532 req-8cd703f2-5c85-4a3c-a953-7fb1b21be99b service nova] Creating event network-vif-deleted:26b58599-e1e8-4de8-a1fd-779b33246181 for instance fb51aefd-c927-464c-a843-4291d9f9ec0b on hv-cinder-82694 Jan 29 03:47:29.074712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-88911f5a-7e87-447f-85d3-add096cc5532 req-8cd703f2-5c85-4a3c-a953-7fb1b21be99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Jan 29 03:47:29.075483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 267/532] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:47:29.158707 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:29.166010 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d6278319-07d0-482f-88d3-a0dfa8840b30 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.171628 Jan 29 03:47:29.166627 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 266/533] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:28 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:29.567473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:29.568140 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:29.574107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:29.574572 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:29.575334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:29.575759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:29.707519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:29.715639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:29.717116 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:29.718278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-10b8f4f3-48d9-441c-a665-85b941995e44 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.155951 Jan 29 03:47:29.718856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 268/534] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:29 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:30.003337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:30.003337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:30.008035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.008476 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.009246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.009670 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.041321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.041740 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.042270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lazy-loading 'fault' on Instance uuid fb51aefd-c927-464c-a843-4291d9f9ec0b {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:30.084543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e533dc110e44f0af37569d8c1b8522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61fc9a8db7445ca8c465347f41732e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:30.091911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8fcb611b-6557-47be-bb1b-b8a565a551d3 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 200 len: 1307 microversion: 2.1 time: 0.094496 Jan 29 03:47:30.092456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 267/535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:29 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:30.189818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:30.190442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:30.197623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.198118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.198920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.199347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.339051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:30.346353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3aa26012-f2c2-4f09-9561-7f8ff4732e40 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.160399 Jan 29 03:47:30.346910 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 269/536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:30 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:30.736063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:30.736811 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:30.743362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.743813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.744925 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.745361 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.878044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:30.886506 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:30.887984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:30.889195 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4e45d3e4-7ef4-4c86-83ed-dc5fe4f998ae tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.156864 Jan 29 03:47:30.889746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 268/537] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:30 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:30.925399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-3ea3e34f-7422-4f5e-8d99-0fc90df64f00 req-d3b16753-06f5-403e-a945-ff1882b56ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "name": "network-vif-plugged", "status": "completed", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:30.930749 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:30.930749 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:30.934769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3ea3e34f-7422-4f5e-8d99-0fc90df64f00 req-d3b16753-06f5-403e-a945-ff1882b56ecb service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:30.935209 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3ea3e34f-7422-4f5e-8d99-0fc90df64f00 req-d3b16753-06f5-403e-a945-ff1882b56ecb service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:30.945807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-3ea3e34f-7422-4f5e-8d99-0fc90df64f00 req-d3b16753-06f5-403e-a945-ff1882b56ecb service nova] Creating event network-vif-plugged:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:47:30.950629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-3ea3e34f-7422-4f5e-8d99-0fc90df64f00 req-d3b16753-06f5-403e-a945-ff1882b56ecb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028654 Jan 29 03:47:30.951168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 270/538] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:31.108529 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:31.109142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] [instance: fb51aefd-c927-464c-a843-4291d9f9ec0b] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:31.115405 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.115859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.116643 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.117080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.130408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] HTTP exception thrown: Instance fb51aefd-c927-464c-a843-4291d9f9ec0b could not be found. Jan 29 03:47:31.131006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] Returning 404 to user: Instance fb51aefd-c927-464c-a843-4291d9f9ec0b could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:31.131832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4bbb25ed-45aa-414f-881f-9290b0b1d2a2 tempest-AttachVolumeNegativeTest-96148746 tempest-AttachVolumeNegativeTest-96148746-project] 10.222.0.16 "GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b" status: 404 len: 111 microversion: 2.1 time: 0.026987 Jan 29 03:47:31.133769 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 269/539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:31 2022] GET /compute/v2.1/servers/fb51aefd-c927-464c-a843-4291d9f9ec0b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:31.268634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:31.269904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:31.281641 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.282475 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.283986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.284983 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.332440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:31.362935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:31.363813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:31.369500 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.369960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.370764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.371206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.540301 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:31.547613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-306c111f-1d1f-49f4-a3e6-1b6f714bf14b tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.188271 Jan 29 03:47:31.548167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 270/540] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:31 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:31.730332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c9076760-dc7b-48e0-88cf-bb5f79134b83 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 204 len: 0 microversion: 2.1 time: 0.468556 Jan 29 03:47:31.732448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 271/541] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:31 2022] DELETE /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:47:31.738854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:31.740191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:31.746893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.747565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.748403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.748840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.881449 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:31.891743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dfe0b1a6-9eba-4986-9604-7ed4796b8034 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1507 microversion: 2.1 time: 0.156446 Jan 29 03:47:31.892859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 271/542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:31 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:31.907025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:31.907824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:31.914990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.915883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:31.916492 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:31.917090 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.056256 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:32.064622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:32.066204 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:32.067333 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-599d0ff1-fdf7-4fd1-8d0b-a1c6e1c8ae3c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.164610 Jan 29 03:47:32.067932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 272/543] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:31 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:32.563774 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:32.564480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:32.571372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:32.571929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.572803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:32.573325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.707532 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:32.715501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-eadb5a0a-9e0a-42f0-b64d-4d9bb3675189 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.155480 Jan 29 03:47:32.719044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 272/544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:32 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:32.910889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:32.912047 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:32.918195 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:32.918643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.919416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:32.919846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.966644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-39454223-db15-4ac8-b3f9-ee172bb542f3 req-cffb5dad-e702-418f-8b67-eb373a4aaff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a90a4b-c57e-418b-8212-bb3b6d945c71", "name": "network-vif-plugged", "status": "completed", "tag": "251d6947-a8c1-4bf3-9996-64aec13dad92"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:32.968741 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:32.968741 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:47:32.977352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-39454223-db15-4ac8-b3f9-ee172bb542f3 req-cffb5dad-e702-418f-8b67-eb373a4aaff5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:32.978009 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-39454223-db15-4ac8-b3f9-ee172bb542f3 req-cffb5dad-e702-418f-8b67-eb373a4aaff5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:32.989334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-39454223-db15-4ac8-b3f9-ee172bb542f3 req-cffb5dad-e702-418f-8b67-eb373a4aaff5 service nova] Creating event network-vif-plugged:251d6947-a8c1-4bf3-9996-64aec13dad92 for instance f7a90a4b-c57e-418b-8212-bb3b6d945c71 on hv-cinder-82694 Jan 29 03:47:32.995192 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-39454223-db15-4ac8-b3f9-ee172bb542f3 req-cffb5dad-e702-418f-8b67-eb373a4aaff5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Jan 29 03:47:33.000074 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 273/545] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:47:33.073592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:33.081334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d311e573-1472-4272-bf77-2fe25b4ef18f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1507 microversion: 2.1 time: 0.173960 Jan 29 03:47:33.081959 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 273/546] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:32 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:33.088452 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:33.089337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:33.096503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:33.096951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:33.097724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:33.098180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:33.249544 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:33.257833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:33.259585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:33.260729 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fc2a1dab-735a-42c4-ad41-8cc3333870e8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.176218 Jan 29 03:47:33.261280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 274/547] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:33 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:33.732320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:33.732914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:33.738770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:33.739216 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:33.740503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:33.740929 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:33.871758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:33.879130 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-56ac03c0-245d-457a-88a2-4ddcaaf556f3 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.150368 Jan 29 03:47:33.879981 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 274/548] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:33 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:34.098153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:34.098766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:34.105313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.105755 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:34.106569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.107007 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:34.261157 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:34.268553 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-78416915-7434-4bb9-8e11-b7715ed3759e tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1507 microversion: 2.1 time: 0.173969 Jan 29 03:47:34.269134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 275/549] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:34 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:34.281659 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:34.282285 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:34.289082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.289521 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:34.290417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.290845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:34.436522 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:34.445181 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:34.446909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:34.448040 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4246d1b8-c534-438d-a7e8-febaccf35b9c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1809 microversion: 2.20 time: 0.170315 Jan 29 03:47:34.448584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 275/550] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:34 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:34.895983 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:34.896605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:34.902474 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.902917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:34.903685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:34.904115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:35.037348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:35.045066 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-afba8b27-45d6-4cfb-a1f5-fb4397c75d3e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1314 microversion: 2.1 time: 0.152997 Jan 29 03:47:35.045642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 276/551] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:34 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:35.288048 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:35.288600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:35.295035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:35.298341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:35.298341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:35.298341 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:35.428718 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:35.436235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-25c0e4f1-4307-42ba-93f8-4455b4513b1b tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1507 microversion: 2.1 time: 0.154662 Jan 29 03:47:35.436928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 276/552] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:35 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:35.466290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:35.466893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:35.473105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:35.473546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:35.474409 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:35.475408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:35.696611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:35.705196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:35.706936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:35.708091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3c4054dd-09f1-4673-a743-c9e43b404833 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1796 microversion: 2.20 time: 0.245443 Jan 29 03:47:35.708683 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 277/553] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:47:35 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1796 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:47:36.061993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:36.062798 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:36.068892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.070546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.070546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.071021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.135572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-b57d64f3-9770-4a13-965d-8af54b3eed60 req-632af538-8ca5-4afa-829c-0c2777894c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5ee017-4daf-4262-8ab0-d31cbfc42bce", "name": "network-vif-deleted", "tag": "5e8c426e-0aed-4140-8239-4f445cd530d4"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:36.137131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:36.137131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:47:36.150603 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b57d64f3-9770-4a13-965d-8af54b3eed60 req-632af538-8ca5-4afa-829c-0c2777894c2c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.151040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b57d64f3-9770-4a13-965d-8af54b3eed60 req-632af538-8ca5-4afa-829c-0c2777894c2c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.173158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-b57d64f3-9770-4a13-965d-8af54b3eed60 req-632af538-8ca5-4afa-829c-0c2777894c2c service nova] Creating event network-vif-deleted:5e8c426e-0aed-4140-8239-4f445cd530d4 for instance ce5ee017-4daf-4262-8ab0-d31cbfc42bce on hv-cinder-82694 Jan 29 03:47:36.179563 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-b57d64f3-9770-4a13-965d-8af54b3eed60 req-632af538-8ca5-4afa-829c-0c2777894c2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047724 Jan 29 03:47:36.180647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 278/554] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:36.255511 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:36.263872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d16fc85d-8832-40f7-b006-b8f9263c9946 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1463 microversion: 2.1 time: 0.205368 Jan 29 03:47:36.264704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 277/555] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:36 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1463 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:36.304901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:36.305494 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:36.311537 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.312411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.312899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.313344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.339724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:36.452611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:36.453259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:36.461312 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.461758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.467543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.467543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.496138 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.496672 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.497182 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'fault' on Instance uuid ce5ee017-4daf-4262-8ab0-d31cbfc42bce {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:36.538156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:36.545415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e99d698f-fd26-4ae9-88a1-79a411d9827d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 200 len: 1312 microversion: 2.1 time: 0.096551 Jan 29 03:47:36.545976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 278/556] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:36 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:36.781897 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-01312a30-2489-4455-91e9-be06c9024130 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 204 len: 0 microversion: 2.1 time: 0.482120 Jan 29 03:47:36.782515 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 279/557] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:36 2022] DELETE /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:47:36.790958 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:36.791694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:36.797259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.797701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.798498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:36.798930 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:36.931811 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:36.938950 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-effe5bb6-7f73-4903-9a0b-40ab3f78553e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1469 microversion: 2.1 time: 0.152200 Jan 29 03:47:36.939511 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 279/558] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:36 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:37.563665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:37.564369 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: ce5ee017-4daf-4262-8ab0-d31cbfc42bce] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:37.571716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.572189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.572956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.573399 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.586929 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] HTTP exception thrown: Instance ce5ee017-4daf-4262-8ab0-d31cbfc42bce could not be found. Jan 29 03:47:37.587522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Returning 404 to user: Instance ce5ee017-4daf-4262-8ab0-d31cbfc42bce could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:37.588350 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-44231c09-4688-4551-8ba6-8a377089bf12 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce" status: 404 len: 111 microversion: 2.1 time: 0.028886 Jan 29 03:47:37.588892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 280/559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:37 2022] GET /compute/v2.1/servers/ce5ee017-4daf-4262-8ab0-d31cbfc42bce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:37.596847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:37.597366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:37.603717 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.604170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.604950 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.605384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.635924 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:47:37.941315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5fcd475b-7a6f-402c-8c2d-7f8baf0b34db tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 204 len: 0 microversion: 2.1 time: 0.347936 Jan 29 03:47:37.941914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 280/560] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:47:37 2022] DELETE /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 29 03:47:37.949520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:37.950198 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:37.955996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:37.956157 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.956501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.956731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:37.957287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.957728 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.962487 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.962924 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:37.964513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:37.964942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:38.095950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:38.106007 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cb29ad48-536c-461d-abd3-db8b78f07995 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.159938 Jan 29 03:47:38.106801 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:38.106959 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 281/561] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:37 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:38.115589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-aefef29b-92d3-4d2c-8ed8-ec2e04946765 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1469 microversion: 2.1 time: 0.162821 Jan 29 03:47:38.116165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 281/562] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:37 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:39.123424 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:39.124024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:39.130306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:39.130724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:39.131502 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:39.131939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:39.133085 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:39.133765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:39.140232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:39.141476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:39.141975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:39.142541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:39.214636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:39.224771 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a9467e9a-04e5-4749-ba44-fb4fb2bc247d tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1427 microversion: 2.1 time: 0.095904 Jan 29 03:47:39.225707 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 282/563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:39 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:47:39.281269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-75e55876-96f0-406e-bfa1-d88fe98112b2 req-3acd9f33-4cc3-4541-8f4a-4615f495de32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a90a4b-c57e-418b-8212-bb3b6d945c71", "name": "network-vif-deleted", "tag": "251d6947-a8c1-4bf3-9996-64aec13dad92"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:39.283003 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:39.283003 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:47:39.296370 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-75e55876-96f0-406e-bfa1-d88fe98112b2 req-3acd9f33-4cc3-4541-8f4a-4615f495de32 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:39.296812 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-75e55876-96f0-406e-bfa1-d88fe98112b2 req-3acd9f33-4cc3-4541-8f4a-4615f495de32 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:39.322656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-75e55876-96f0-406e-bfa1-d88fe98112b2 req-3acd9f33-4cc3-4541-8f4a-4615f495de32 service nova] Creating event network-vif-deleted:251d6947-a8c1-4bf3-9996-64aec13dad92 for instance f7a90a4b-c57e-418b-8212-bb3b6d945c71 on hv-cinder-82694 Jan 29 03:47:39.329788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-75e55876-96f0-406e-bfa1-d88fe98112b2 req-3acd9f33-4cc3-4541-8f4a-4615f495de32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053960 Jan 29 03:47:39.330439 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 283/564] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:39.373358 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:39.383000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6b4ac421-b93b-4370-a7ac-03a05d6df34d tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.263142 Jan 29 03:47:39.383573 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:39 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:40.244786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:40.245575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:40.252577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:40.254031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:40.255132 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:40.255785 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:40.287146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:40.287665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:40.288675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lazy-loading 'fault' on Instance uuid f7a90a4b-c57e-418b-8212-bb3b6d945c71 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:40.329059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc0d7cc6d740aaa95e7646e5ab9c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b5db208544c64ba32651c83dcb7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:40.337072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0ddc3573-b7d1-48be-8398-b04c8c71b0c9 tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 200 len: 1304 microversion: 2.1 time: 0.097621 Jan 29 03:47:40.337661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 284/566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:40 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:40.400550 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:40.401154 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:40.407119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:40.407654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:40.408453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:40.408884 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:40.552225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:40.559846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-579bbc05-bc6c-435e-9ab2-0ab35415d535 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.163495 Jan 29 03:47:40.560401 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:40 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:41.359976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:41.360751 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] [instance: f7a90a4b-c57e-418b-8212-bb3b6d945c71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:41.367875 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.368313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.369488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.369994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.385751 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] HTTP exception thrown: Instance f7a90a4b-c57e-418b-8212-bb3b6d945c71 could not be found. Jan 29 03:47:41.386355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] Returning 404 to user: Instance f7a90a4b-c57e-418b-8212-bb3b6d945c71 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:41.387143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9f78ab01-9f02-4aad-89b6-80be0946d24e tempest-VolumesNegativeTest-63969085 tempest-VolumesNegativeTest-63969085-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71" status: 404 len: 111 microversion: 2.1 time: 0.031896 Jan 29 03:47:41.387644 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 285/568] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:41 2022] GET /compute/v2.1/servers/f7a90a4b-c57e-418b-8212-bb3b6d945c71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:41.576518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:41.577125 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:41.583433 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.583884 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.584742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.585183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.678679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:41.681998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:41.691917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.693752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.694706 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:41.695354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:41.748462 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:41.756447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-49854022-a327-400f-98bc-bfb326c0e532 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.183673 Jan 29 03:47:41.757288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:41 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:41.782782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lazy-loading 'services' on Instance uuid 45fc5079-1458-479d-b5b0-d0b0fb1e9235 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:42.021024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e614761b-bccd-4cf3-a997-2f349e173a06 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments/8756ba81-4349-4e53-9268-82ae88e2af43" status: 202 len: 0 microversion: 2.1 time: 0.347464 Jan 29 03:47:42.021550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 286/570] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:47:41 2022] DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments/8756ba81-4349-4e53-9268-82ae88e2af43 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:47:42.773085 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:42.773697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:42.780203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:42.780665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:42.781454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:42.781894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:42.929520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:42.937984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a42e5960-c8b4-4b45-901a-9f6e25fc12a9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.168787 Jan 29 03:47:42.938565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 285/571] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:42 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:43.959084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:43.959838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:43.968411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:43.968853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:43.969615 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:43.970041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:44.114661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:44.122675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f0b23c7e-5f25-4a8a-bb46-dd457f99eef9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.170020 Jan 29 03:47:44.123227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 287/572] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:43 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:44.247773 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-17e0c442-df97-4f32-b2c3-c4a54e7ba199 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:44.254123 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-17e0c442-df97-4f32-b2c3-c4a54e7ba199 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:44.254610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-17e0c442-df97-4f32-b2c3-c4a54e7ba199 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:44.283779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-17e0c442-df97-4f32-b2c3-c4a54e7ba199 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Going to try to stop instance {{(pid=123254) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 29 03:47:44.453213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-17e0c442-df97-4f32-b2c3-c4a54e7ba199 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action" status: 202 len: 0 microversion: 2.1 time: 0.209317 Jan 29 03:47:44.453815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 286/573] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:47:44 2022] POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:47:44.461691 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:44.462328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:44.468909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:44.469358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:44.470120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:44.470703 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:44.605192 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:44.612655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-839e6239-a57d-4b8c-86fa-81de7fb7bc72 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.154565 Jan 29 03:47:44.613323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 288/574] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:44 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:45.140388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:45.141090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:45.147236 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:45.147691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:45.148472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:45.148908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:45.283181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:45.291351 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d7034207-e42d-4059-82cc-c6e02d256fce tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1520 microversion: 2.1 time: 0.154328 Jan 29 03:47:45.291908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 287/575] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:45 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:45.630364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:45.631408 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:45.639724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:45.639724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:45.639724 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:45.640390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:45.802754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:45.810922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7cb9d97e-5ac1-4040-9a98-10babf098716 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.184167 Jan 29 03:47:45.811488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 289/576] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:45 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:45.838717 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-d81067a2-c070-4410-95a7-128b297d7723 req-4e3bc1e0-da1c-48d0-9bba-93482484e5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333eec8c-4437-4fe4-9440-e0210b9b6b71", "name": "network-vif-deleted", "tag": "99574264-03c0-4cb9-9094-a916433c52ab"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:45.840256 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:47:45.840256 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:47:45.846979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-d81067a2-c070-4410-95a7-128b297d7723 req-4e3bc1e0-da1c-48d0-9bba-93482484e5b9 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:45.847425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-d81067a2-c070-4410-95a7-128b297d7723 req-4e3bc1e0-da1c-48d0-9bba-93482484e5b9 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:45.858488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-d81067a2-c070-4410-95a7-128b297d7723 req-4e3bc1e0-da1c-48d0-9bba-93482484e5b9 service nova] Creating event network-vif-deleted:99574264-03c0-4cb9-9094-a916433c52ab for instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 on hv-cinder-82694 Jan 29 03:47:45.863106 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-d81067a2-c070-4410-95a7-128b297d7723 req-4e3bc1e0-da1c-48d0-9bba-93482484e5b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028006 Jan 29 03:47:45.863671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 288/577] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:47:46.308159 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:46.308755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:46.314685 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:46.315129 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:46.315892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:46.316319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:46.377683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:46.384942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-274527d4-978e-4a6b-91ef-6a016e7977c9 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1478 microversion: 2.1 time: 0.080400 Jan 29 03:47:46.385491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 290/578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:46 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1478 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:46.829069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:46.829763 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:46.835772 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:46.836220 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:46.836993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:46.837428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:46.967604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:46.974957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-000318a0-4f16-442b-85d1-202f5eacf662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.150299 Jan 29 03:47:46.975513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 289/579] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:46 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:47.135540 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:47:47.135757 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 03:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:47:47.402786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:47.403331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:47.410317 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:47.411073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:47.412006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:47.412438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:47.447759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:47.448217 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:47.448666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lazy-loading 'fault' on Instance uuid 333eec8c-4437-4fe4-9440-e0210b9b6b71 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:47:47.488323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a0c13cce84006bd75226460140783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995678f3901441a099ca67990ffaa293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:47.496106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-505f1b56-0407-4ef9-9028-d61aa9fecb09 tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 200 len: 1311 microversion: 2.1 time: 0.097876 Jan 29 03:47:47.496668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 291/580] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:47 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:47.992509 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:47.993153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:47.999809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:48.000264 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:48.001043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:48.001483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:48.136054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:48.143285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-aeda63c9-b7b2-4ff6-9f5e-00c338d4260e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.154401 Jan 29 03:47:48.143836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 290/581] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:47 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:48.513386 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:48.514107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] [instance: 333eec8c-4437-4fe4-9440-e0210b9b6b71] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:48.520623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:48.523356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:48.523356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:48.523356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:48.535850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] HTTP exception thrown: Instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 could not be found. Jan 29 03:47:48.536437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] Returning 404 to user: Instance 333eec8c-4437-4fe4-9440-e0210b9b6b71 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:47:48.537234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-63698e60-739f-487a-b704-6635f4ad222f tempest-ServerRescueNegativeTestJSON-350683971 tempest-ServerRescueNegativeTestJSON-350683971-project] 10.222.0.16 "GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71" status: 404 len: 111 microversion: 2.1 time: 0.028099 Jan 29 03:47:48.537756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 292/582] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:48 2022] GET /compute/v2.1/servers/333eec8c-4437-4fe4-9440-e0210b9b6b71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:47:49.160637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:49.161779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:49.168546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:49.169216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:49.170405 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:49.170993 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:49.493033 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:49.501637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-49305b73-0115-4354-95c4-afd5c7fa25a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.344510 Jan 29 03:47:49.502434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 291/583] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:49 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:50.519866 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:50.521066 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:50.527826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:50.528467 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:50.529819 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:50.530553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:50.707238 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:50.715655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-814790ba-35d9-4c70-8322-2034846a4bc4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.199842 Jan 29 03:47:50.716518 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 293/584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:50 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:51.735968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:51.736600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:51.743249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:51.743615 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:51.744437 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:51.744871 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:51.995175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:52.005877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4512cb3c-1262-4cad-a1a2-073dff57b9b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.270552 Jan 29 03:47:52.005877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 292/585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:51 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:53.021544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:53.022207 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:53.029609 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:53.030064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:53.033302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:53.033302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:53.162857 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:53.170173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d08105be-42fa-4b84-aa76-612846bee662 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.153788 Jan 29 03:47:53.170815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 294/586] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:53 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:54.188862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:54.190460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:54.197817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:54.198628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:54.199538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:54.200062 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:54.427028 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:54.436547 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a682ea5b-6c61-4672-88d5-7971d6791c9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.253057 Jan 29 03:47:54.437112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 293/587] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:54 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:55.453180 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:55.459830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:55.467613 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:55.468427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:55.469633 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:55.470362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:55.631503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:55.641198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e83cba50-9221-4ec9-922e-590f97c19b12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.192144 Jan 29 03:47:55.652394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 295/588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:55 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:56.659313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:56.660026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:56.669570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:56.671243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:56.673134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:56.675349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:56.900173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:56.910221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1774e2d8-571b-4193-9a02-2cc97c2341c4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1678 microversion: 2.1 time: 0.254580 Jan 29 03:47:56.911607 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 294/589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:56 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:57.927358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:57.929299 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:57.936564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:57.937022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:57.937824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:57.938914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:58.112324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:58.132565 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3ec9d5ea-fb0c-45c1-926c-0f227c23aa12 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1655 microversion: 2.1 time: 0.208878 Jan 29 03:47:58.147971 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 296/590] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:57 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1655 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:58.153691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dbed3cb6-00c2-4ea1-8d7e-5c0443ff37e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:47:58.163708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbed3cb6-00c2-4ea1-8d7e-5c0443ff37e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:58.165485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbed3cb6-00c2-4ea1-8d7e-5c0443ff37e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:58.191497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dbed3cb6-00c2-4ea1-8d7e-5c0443ff37e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Going to try to start instance {{(pid=123254) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 29 03:47:58.392152 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dbed3cb6-00c2-4ea1-8d7e-5c0443ff37e5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action" status: 202 len: 0 microversion: 2.1 time: 0.242333 Jan 29 03:47:58.393046 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 295/591] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:47:58 2022] POST /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:47:58.406437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:58.407364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:58.416638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:58.417639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:58.418868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:58.419718 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:58.587529 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:58.595634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e9808c7c-911f-4cc6-86d4-bcb586de68ca tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1664 microversion: 2.1 time: 0.193628 Jan 29 03:47:58.596199 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 297/592] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:58 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:47:59.614867 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:47:59.615568 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:47:59.645499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:59.645953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:59.648832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:47:59.649275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:47:59.875395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:47:59.892756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-eab5247e-7ebc-48c9-af19-ce6fa1fa563e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1664 microversion: 2.1 time: 0.283226 Jan 29 03:47:59.894893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 296/593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:47:59 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1664 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:00.911286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:00.912064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:00.929420 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:00.932037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:00.933029 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:00.933691 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:01.178855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:01.188967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ad191448-eeac-44d8-9fd7-04daae621f40 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1668 microversion: 2.1 time: 0.281055 Jan 29 03:48:01.189958 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 298/594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:00 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:06.058675 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Action: 'create', calling method: .version_select at 0x7f45009d0c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-86261245"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:06.074613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:06.079028 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for user feda89ffc1894415bf64f0b8b303cd86 and project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:06.643031 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:06.647199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for user feda89ffc1894415bf64f0b8b303cd86 and project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:06.660552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4fd24ae7-70a6-43d5-928b-1e4406814b0b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.849956 Jan 29 03:48:06.661140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 297/595] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Jan 29 03:48:05 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:09.017904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:09.018532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:09.025835 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.026332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.027247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.027541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.063446 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5d535881-3d95-48cd-9165-6cec395fb1ee tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments/63dad7e6-f7db-422c-85d3-7a3672f98c92" status: 200 len: 194 microversion: 2.20 time: 0.049308 Jan 29 03:48:09.069818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 299/596] 10.222.0.16 () {60 vars in 1453 bytes} [Sat Jan 29 03:48:09 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments/63dad7e6-f7db-422c-85d3-7a3672f98c92 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:48:09.132130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:09.132653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:09.140634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.141312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.142331 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.142759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.258987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lazy-loading 'services' on Instance uuid 8f5813a3-d10f-42ef-99a5-50aa1af18f3a {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:48:09.531356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7299fb17-a8c8-4d5a-a06a-70856d456495 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments/63dad7e6-f7db-422c-85d3-7a3672f98c92" status: 202 len: 0 microversion: 2.20 time: 0.403262 Jan 29 03:48:09.536924 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 298/597] 10.222.0.16 () {60 vars in 1456 bytes} [Sat Jan 29 03:48:09 2022] DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments/63dad7e6-f7db-422c-85d3-7a3672f98c92 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:48:09.546123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:09.547144 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:09.559375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.559824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.561305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:09.561727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:09.603901 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c35cea77-e6ed-4cf4-a8be-4e2af4a22597 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067328 Jan 29 03:48:09.606245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 300/598] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Jan 29 03:48:09 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:48:10.617334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:10.618994 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:10.628900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:10.629568 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:10.630701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:10.631429 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:10.664702 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5cdabf36-62d5-418e-a4b6-194ef49f0be7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052156 Jan 29 03:48:10.665278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 299/599] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Jan 29 03:48:10 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:48:11.676797 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:11.677701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:11.684765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:11.685213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:11.685997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:11.686462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:11.714931 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c3eba3b4-5101-4e55-b868-35b171b41ff3 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042070 Jan 29 03:48:11.715744 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 301/600] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Jan 29 03:48:11 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:11.782328 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:11.784748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:11.790006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:11.791250 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:11.792081 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:11.792521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:11.818917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:48:12.124383 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-80d1ff49-720c-48a5-b360-4693da74bcf8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 204 len: 0 microversion: 2.20 time: 0.345626 Jan 29 03:48:12.124962 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 300/601] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Jan 29 03:48:11 2022] DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 29 03:48:12.132868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:12.133465 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:12.139317 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:12.139756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:12.140525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:12.140955 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:12.286798 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:12.294416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:12.296105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:12.297353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-50823f3e-6b32-4589-b192-fb0e26db069d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.168255 Jan 29 03:48:12.298070 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 302/602] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:12 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:13.318954 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:13.319592 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:13.325836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:13.326317 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:13.327089 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:13.327551 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:13.469742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:13.478790 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:13.480388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:13.481594 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7a6f5864-2db2-433c-803d-6e5c6fa43c83 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.166970 Jan 29 03:48:13.482148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 301/603] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:13 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:14.499556 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:14.500170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:14.506483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:14.506927 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:14.507701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:14.508139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:14.655752 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:14.663368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:14.664845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:14.666602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-80960e42-7d45-4421-8de8-f057ba663589 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.170691 Jan 29 03:48:14.667146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 303/604] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:14 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:15.684846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:15.685397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:15.691618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:15.692060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:15.692825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:15.693251 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:15.832900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:15.841155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:15.842682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:15.843833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8b232858-c349-4a23-b673-fa1d7eb332ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.163401 Jan 29 03:48:15.850899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 302/605] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:15 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:16.864306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:16.865339 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:16.874428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:16.874877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:16.875665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:16.876099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:17.021640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:17.029705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:17.031225 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:17.032353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-07245c11-65ed-4c25-9331-c41f0b35a35a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.172559 Jan 29 03:48:17.032908 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 304/606] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:16 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:18.050597 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:18.051225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:18.057562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:18.058011 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:18.058827 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:18.059263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:18.203827 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:18.213744 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:18.215280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:18.220265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d1846280-5658-47c1-9e30-281f3b0215ed tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.169609 Jan 29 03:48:18.220265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 303/607] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:18 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:19.235175 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:19.235769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:19.242272 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:19.242796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:19.244244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:19.244669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:19.381604 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:19.389700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:19.391201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:19.392345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9506a27f-2abf-40d1-9147-47b7305ce481 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.160851 Jan 29 03:48:19.392900 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 305/608] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:19 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:20.411160 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:20.411794 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:20.418587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:20.419698 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:20.419951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:20.420399 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:20.649850 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:20.657846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:20.659417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:20.660565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1a4a68e9-9f1c-4280-a4ee-514e18cfc3fa tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1724 microversion: 2.20 time: 0.253195 Jan 29 03:48:20.661326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 304/609] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:20 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:21.644746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-c87909a5-b35a-4358-abce-172a49ade550 req-520cdf51-798c-4bcf-927f-5de729657b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5813a3-d10f-42ef-99a5-50aa1af18f3a", "name": "network-vif-deleted", "tag": "126ac57e-93f8-430b-8a67-93adec80b5d3"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:21.646291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:21.646291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:21.655037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-c87909a5-b35a-4358-abce-172a49ade550 req-520cdf51-798c-4bcf-927f-5de729657b56 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:21.658560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-c87909a5-b35a-4358-abce-172a49ade550 req-520cdf51-798c-4bcf-927f-5de729657b56 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:21.670099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-c87909a5-b35a-4358-abce-172a49ade550 req-520cdf51-798c-4bcf-927f-5de729657b56 service nova] Creating event network-vif-deleted:126ac57e-93f8-430b-8a67-93adec80b5d3 for instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a on hv-cinder-82694 Jan 29 03:48:21.676440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-c87909a5-b35a-4358-abce-172a49ade550 req-520cdf51-798c-4bcf-927f-5de729657b56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034933 Jan 29 03:48:21.677301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 306/610] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:21.680679 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:21.681124 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:21.688423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:21.688909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:21.690020 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:21.690961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:21.756438 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:21.765386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:21.767317 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:21.769299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a68f32dc-d6b7-4afc-a405-c3cde67d4f49 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 200 len: 1656 microversion: 2.20 time: 0.093626 Jan 29 03:48:21.770522 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 305/611] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:21 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 1656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:48:22.789229 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:22.789919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:22.797493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:22.797947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:22.798754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:22.799192 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:22.813169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. Jan 29 03:48:22.816643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:48:22.816643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b577cf50-7bfd-409f-804c-1719088a6b92 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 404 len: 111 microversion: 2.20 time: 0.029485 Jan 29 03:48:22.816643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 307/612] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:22 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:48:22.823407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e0d4203d-6558-44c8-a414-d30ca36acb29 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '.version_select at 0x7f45009695e0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:22.915224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e0d4203d-6558-44c8-a414-d30ca36acb29 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407818180" status: 204 len: 0 microversion: 2.20 time: 0.095296 Jan 29 03:48:22.916774 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 306/613] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Jan 29 03:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407818180 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 29 03:48:23.841887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: .version_select at 0x7f45012ce820>, body: {"keypair": {"name": "tempest-keypair-2122172846"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:23.861309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:23.865250 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:24.156782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:24.161631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:24.178243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8d6e02a3-d489-43a0-ac79-da77343a5cd0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.339836 Jan 29 03:48:24.179152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 308/614] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Jan 29 03:48:23 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 29 03:48:26.979960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1288343593", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204ced72-9299-4a30-aa72-466acced45bf"}], "security_groups": [{"name": "tempest-securitygroup--118814026"}], "key_name": "tempest-keypair-2122172846", "user_data": "}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:27.080926 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] validate_networks() for [('204ced72-9299-4a30-aa72-466acced45bf', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:48:27.479678 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:48:27.480100 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:48:27.480568 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:48:27.481165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:48:27.481676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:48:27.490657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:27.491093 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:27.491916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:27.492357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:27.508754 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:27.512669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Getting quotas for user 51fef0e311694ddcb029528bee9d5da5 and project 00cfcd24ac464466b0c59b2955aac89e. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:27.523382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:48:27.526246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:48:27.657518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4816cecc-9fc1-4ca6-91be-9138f553efe8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.682156 Jan 29 03:48:27.658324 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 307/615] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Jan 29 03:48:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 29 03:48:27.669171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:27.669774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:27.726490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:27.734107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:27.735661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:27.736741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d0f5e7c5-e089-4b9a-b137-8149c21fff7f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1282 microversion: 2.20 time: 0.072387 Jan 29 03:48:27.737286 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 309/616] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:27 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:28.754770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:28.755379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:28.761896 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:28.762380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:28.763150 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:28.763585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:28.821812 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:28.829495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:28.834181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:28.834181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-737cdf88-87ba-4402-8b19-16329b4b8890 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1286 microversion: 2.20 time: 0.081586 Jan 29 03:48:28.834181 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 308/617] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:28 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:29.849189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:29.849791 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:29.856359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:29.856880 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:29.857728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:29.858281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:29.919520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:29.927334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:29.928884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:29.929962 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7563336d-8abe-4c14-8da7-158a1a7b607f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1334 microversion: 2.20 time: 0.084552 Jan 29 03:48:29.930557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 310/618] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:29 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:30.952885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:30.953493 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:30.959852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:30.960306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:30.961086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:30.961531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:31.028695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:31.036454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:31.037958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:31.039092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b5f55ea7-819a-4c7f-ac40-0c82ad79b65a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1340 microversion: 2.20 time: 0.090005 Jan 29 03:48:31.039644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 309/619] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:30 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:48:31.348938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-98753962", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-86261245", "security_groups": [{"name": "tempest-secgroup-smoke-100694136"}], "networks": [{"uuid": "9ce03b02-e4c1-4b51-89f8-2b8c7e281b14"}], "block_device_mapping_v2": [{"uuid": "cdcd30b7-9afb-4864-bb4e-162335c194a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:31.465396 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] validate_networks() for [('9ce03b02-e4c1-4b51-89f8-2b8c7e281b14', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:48:31.835917 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:48:31.836552 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:48:31.837014 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:48:31.837473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:48:31.838414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:48:31.848546 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:31.849018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:31.849991 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:31.850636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:31.867202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:31.871496 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Getting quotas for user feda89ffc1894415bf64f0b8b303cd86 and project 033b0334af9941dfbcf5ac732f36dfd6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:31.939205 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:48:31.941334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdcd30b7-9afb-4864-bb4e-162335c194a8',volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:48:32.050545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-51869a22-fe80-4b39-85ac-6d52de4234fb req-cbd9f02b-c015-44c6-b357-950cadc5cfdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:32.052385 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:32.052385 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:48:32.062940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-51869a22-fe80-4b39-85ac-6d52de4234fb req-cbd9f02b-c015-44c6-b357-950cadc5cfdd service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:32.063342 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-51869a22-fe80-4b39-85ac-6d52de4234fb req-cbd9f02b-c015-44c6-b357-950cadc5cfdd service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:32.076276 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-51869a22-fe80-4b39-85ac-6d52de4234fb req-cbd9f02b-c015-44c6-b357-950cadc5cfdd service nova] Creating event network-changed:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:48:32.081691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-51869a22-fe80-4b39-85ac-6d52de4234fb req-cbd9f02b-c015-44c6-b357-950cadc5cfdd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034667 Jan 29 03:48:32.082410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 310/620] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:48:32.087847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:32.088548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:32.094960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:32.095414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:32.096216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:32.096647 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:32.244512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:32.252386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:32.253948 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:32.255098 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-daf9ec30-27df-4b4d-974d-54e309af2a82 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.171380 Jan 29 03:48:32.255649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 311/621] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:32 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:32.394705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-44ecd418-85d2-43a2-9acf-306bd197e92b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.049718 Jan 29 03:48:32.396077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 311/622] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:48:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:48:32.404701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-aec5cd15-cf97-4855-aa1f-dec0dc37854a tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:32.405305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-aec5cd15-cf97-4855-aa1f-dec0dc37854a tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:32.459051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-aec5cd15-cf97-4855-aa1f-dec0dc37854a tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:32.465407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-aec5cd15-cf97-4855-aa1f-dec0dc37854a tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1085 microversion: 2.1 time: 0.064275 Jan 29 03:48:32.465968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 312/623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:32 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1085 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:33.273471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:33.274061 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:33.280637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:33.281075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:33.281836 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:33.282295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:33.419474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:33.427504 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:33.428982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:33.430051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-06a8dcef-7aeb-4a26-a378-fe6c8cc8ea1d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.160389 Jan 29 03:48:33.430622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 312/624] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:33 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:33.481669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7dadc1bf-290d-4058-8818-93059233f303 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:33.482400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7dadc1bf-290d-4058-8818-93059233f303 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:33.538649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7dadc1bf-290d-4058-8818-93059233f303 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:33.545629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7dadc1bf-290d-4058-8818-93059233f303 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1085 microversion: 2.1 time: 0.067579 Jan 29 03:48:33.546207 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 313/625] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:33 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1085 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:34.447824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:34.448423 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:34.455082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:34.455527 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:34.456300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:34.456729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:34.563946 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:34.565066 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:34.573765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:34.574236 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:34.575032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:34.575470 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:34.608892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:34.617668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:34.619375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:34.620607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-dabc4b05-2781-45b2-b191-0e681140348e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.176591 Jan 29 03:48:34.622163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 313/626] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:34 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:34.679125 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:34.689485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0353ce7c-16cc-4b4d-8000-d9953a374ca0 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1127 microversion: 2.1 time: 0.128078 Jan 29 03:48:34.689485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 314/627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:34 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1127 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:35.638186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:35.638900 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:35.645826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:35.646291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:35.647435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:35.647864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:35.703921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:35.705109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:35.713280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:35.713978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:35.715011 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:35.715655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:35.793417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:35.801501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6bfa9ea2-ca87-4af3-9cb6-b26cbebba62c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1201 microversion: 2.1 time: 0.101211 Jan 29 03:48:35.802382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 315/628] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:35 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:35.812657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:35.820685 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:35.822345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:35.823476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a39a3c6f-25e9-418a-a18c-9f862ddab730 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.189232 Jan 29 03:48:35.824026 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 314/629] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:35 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:36.818405 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:36.819104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:36.826036 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:36.826519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:36.827310 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:36.827782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:36.841176 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:36.841942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:36.848537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:36.849099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:36.849986 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:36.850573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:36.997222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:37.009309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:37.011967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:37.013353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2e5a2b69-3b20-4d5b-8591-e34687ea571c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.176485 Jan 29 03:48:37.014041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 315/630] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:36 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:48:37.022874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:37.033305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8e3a5df4-8ce5-4f10-b159-fa084df5223e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1268 microversion: 2.1 time: 0.218652 Jan 29 03:48:37.034355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 316/631] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:36 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:37.310326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-837ed65e-e273-4d96-87cc-b69ab7b45b91 req-08280df5-e8b6-4ada-86d9-56ca435e32a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:37.311744 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:37.311744 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:37.321558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-837ed65e-e273-4d96-87cc-b69ab7b45b91 req-08280df5-e8b6-4ada-86d9-56ca435e32a3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:37.321906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-837ed65e-e273-4d96-87cc-b69ab7b45b91 req-08280df5-e8b6-4ada-86d9-56ca435e32a3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:37.342883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-837ed65e-e273-4d96-87cc-b69ab7b45b91 req-08280df5-e8b6-4ada-86d9-56ca435e32a3 service nova] Creating event network-changed:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:48:37.351338 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-837ed65e-e273-4d96-87cc-b69ab7b45b91 req-08280df5-e8b6-4ada-86d9-56ca435e32a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051104 Jan 29 03:48:37.352124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 316/632] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:38.031789 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:38.033363 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:38.041022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:38.041479 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:38.042934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:38.043841 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:38.054895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:38.056149 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:38.064043 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:38.064498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:38.065588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:38.066027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:38.242590 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:38.257005 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3beb35f7-8f64-4d44-87b5-6c1117f2d9e8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.199195 Jan 29 03:48:38.258699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 317/633] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:38 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:38.294476 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:38.302259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:38.303768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:38.304921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b8b385cf-68b5-4021-9600-d48af10bafa8 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.277422 Jan 29 03:48:38.305481 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 317/634] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:38 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:39.275435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:39.276228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:39.285697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:39.286421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:39.287366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:39.287742 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:39.323151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:39.323735 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:39.329564 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:39.330019 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:39.330846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:39.331281 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:39.430945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:39.438838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f66aaadc-9f0f-481c-88bf-2492237a22f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.167542 Jan 29 03:48:39.439405 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 318/635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:39 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:39.468292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:39.476180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:39.477766 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:39.478956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6305dbb7-a5c8-4996-bed5-7e3b5a1c59c0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.159831 Jan 29 03:48:39.480113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 318/636] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:39 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:48:39.602080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-b52aa275-bbbc-4825-89b3-f242c1745845 req-0c8457ef-2697-4774-b60f-0a97f03ae46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "name": "network-vif-plugged", "status": "completed", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:39.609173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:39.609173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:39.611400 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-b52aa275-bbbc-4825-89b3-f242c1745845 req-0c8457ef-2697-4774-b60f-0a97f03ae46f service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:39.611897 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-b52aa275-bbbc-4825-89b3-f242c1745845 req-0c8457ef-2697-4774-b60f-0a97f03ae46f service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:39.623287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-b52aa275-bbbc-4825-89b3-f242c1745845 req-0c8457ef-2697-4774-b60f-0a97f03ae46f service nova] Creating event network-vif-plugged:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:48:39.628269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-b52aa275-bbbc-4825-89b3-f242c1745845 req-0c8457ef-2697-4774-b60f-0a97f03ae46f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029932 Jan 29 03:48:39.628839 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 319/637] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:40.454753 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:40.455360 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:40.461377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:40.461852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:40.462689 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:40.463297 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:40.506889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:40.512105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:40.517898 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:40.518448 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:40.520107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:40.520760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:40.620764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:40.628572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4ee99950-7d64-4611-92ae-864d444b89f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.177355 Jan 29 03:48:40.636155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 319/638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:40 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:40.668329 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:40.676072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:40.677582 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:40.678692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f6e66181-5e62-4a85-b8be-719a54c29dd9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1407 microversion: 2.20 time: 0.184514 Jan 29 03:48:40.679229 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 320/639] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:40 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:41.645206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:41.645891 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:41.652893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.653340 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:41.654169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.654663 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:41.696614 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:41.697331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:41.704302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.704781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:41.705623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.706000 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:41.800380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:41.808383 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c228c8ca-cf7b-4156-a850-7436d05e23f7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.167358 Jan 29 03:48:41.808945 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 320/640] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:41 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:41.899657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:41.907458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:41.908949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:41.910081 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-99812b2a-1cd9-4549-b4c5-da36e83fb88e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1600 microversion: 2.20 time: 0.217235 Jan 29 03:48:41.910664 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 321/641] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:41 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:48:41.926900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:41.927390 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:41.933646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.934090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:41.934906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:41.935338 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:42.019321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ecd65418-b0b0-4c57-be0b-1b56b05475db tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095730 Jan 29 03:48:42.020889 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 321/642] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Jan 29 03:48:41 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:48:42.825156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:42.825758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:42.831969 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:42.832416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:42.833188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:42.833622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:42.983680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:42.991594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-281b8d38-e07c-4f56-b70d-edcab2801979 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.170662 Jan 29 03:48:42.992241 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:42 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:43.384112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:43.386221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:43.386410 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a7c848bb-b925-4f6b-b772-d33f210b78cf req-1ddc7c60-b789-4754-bad0-58206624b021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:43.387947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:43.387947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:43.394796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:43.395242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a7c848bb-b925-4f6b-b772-d33f210b78cf req-1ddc7c60-b789-4754-bad0-58206624b021 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:43.395690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a7c848bb-b925-4f6b-b772-d33f210b78cf req-1ddc7c60-b789-4754-bad0-58206624b021 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:43.395824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:43.396944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:43.397607 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:43.409165 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a7c848bb-b925-4f6b-b772-d33f210b78cf req-1ddc7c60-b789-4754-bad0-58206624b021 service nova] Creating event network-changed:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:48:43.415021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a7c848bb-b925-4f6b-b772-d33f210b78cf req-1ddc7c60-b789-4754-bad0-58206624b021 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032677 Jan 29 03:48:43.415681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 323/644] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:48:43.624200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:43.633400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:43.634928 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:43.636095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0d32f46e-3b2b-4602-b407-0aa00bd928a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1600 microversion: 2.20 time: 0.256180 Jan 29 03:48:43.636882 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 322/645] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:43 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1600 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:44.009957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:44.011077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:44.018592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.018592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.019783 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.020535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.178839 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:44.186712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a6d73235-d024-4267-8e9e-c8254cd77370 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.181523 Jan 29 03:48:44.197133 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 324/646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:44 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:44.655341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:44.656068 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:44.662430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.662878 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.663656 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.664090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.822290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:44.830975 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:44.832518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:44.833686 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-976519d2-a316-42d3-911b-a1407c2b0929 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1719 microversion: 2.20 time: 0.182671 Jan 29 03:48:44.834296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 323/647] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:48:44 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:48:44.851599 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:44.852169 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:44.858043 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.858605 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.859377 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:44.859803 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:44.883335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-78f46668-111b-49fd-b3a6-28191b043609 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/ips" status: 200 len: 153 microversion: 2.20 time: 0.036038 Jan 29 03:48:44.883832 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 325/648] 10.222.0.16 () {60 vars in 1288 bytes} [Sat Jan 29 03:48:44 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:48:45.158604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-15256198", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "5fe69e09-472f-4f8c-8e21-fc6cbc9e2e6e"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:45.204520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:45.205153 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:45.208347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] validate_networks() for [('5fe69e09-472f-4f8c-8e21-fc6cbc9e2e6e', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:48:45.211768 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:45.212217 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:45.212993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:45.214024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:45.365220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:45.373977 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-948a1527-d3ca-4796-918a-7fe561553a46 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.173099 Jan 29 03:48:45.383251 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 326/649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:45 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:45.554575 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:48:45.555045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:48:45.560325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:48:45.560325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:48:45.560325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:48:45.565258 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:45.565703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:45.566567 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:45.567024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:45.583306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Getting quotas for project de38e16f36a046dea407a31c4a9e110a. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:45.587212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Getting quotas for user 62ada98da8824d88874d34ad4aa5dae1 and project de38e16f36a046dea407a31c4a9e110a. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:45.598150 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:48:45.600475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:48:45.731322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-07436f0c-6347-4f6c-86e1-cba8ca4e860c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576310 Jan 29 03:48:45.732681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 324/650] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:48:45.741745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-566ab2b1-c176-4f18-8f55-ae1350913b3c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:45.742600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-566ab2b1-c176-4f18-8f55-ae1350913b3c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:45.806954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-566ab2b1-c176-4f18-8f55-ae1350913b3c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:45.806954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-566ab2b1-c176-4f18-8f55-ae1350913b3c tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1212 microversion: 2.1 time: 0.065171 Jan 29 03:48:45.806954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 327/651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:45 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1212 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:46.390494 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:46.391129 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:46.397966 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:46.398565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:46.399412 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:46.399901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:46.569499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:46.577016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-75246b80-cf17-42b1-af74-ee91e808030f tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.190157 Jan 29 03:48:46.577585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 325/652] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:46 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:46.819580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:46.820188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:46.826907 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:46.827355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:46.828133 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:46.828566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:46.898271 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:46.903761 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-59630905-3f75-4687-97ed-4efaba77d5f0 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1216 microversion: 2.1 time: 0.087782 Jan 29 03:48:46.904519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 328/653] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:46 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:47.598447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:47.599168 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:47.606600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:47.607164 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:47.608042 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:47.608548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:47.754440 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:47.763722 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-96f1ca1c-08ff-483b-bdb7-6ec82986955d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.168967 Jan 29 03:48:47.764411 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 326/654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:47 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:47.920939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:47.921551 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:47.927817 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:47.928261 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:47.929037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:47.929477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:47.995141 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:48.002792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-aa4bc444-6b84-457f-9a87-1bb96a2b7463 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1264 microversion: 2.1 time: 0.086089 Jan 29 03:48:48.003939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 329/655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:47 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:48.789536 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:48.790182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:48.797033 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:48.797483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:48.798372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:48.798817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:49.000708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:49.008226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-62508c08-1f27-4b42-8a7e-68553200f6fd tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.222310 Jan 29 03:48:49.009294 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 327/656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:48 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:49.025926 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:49.026567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:49.033274 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:49.033730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:49.034651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:49.035090 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:49.176247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:49.185684 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-65f70edc-89ff-4334-bbab-088597d72bd2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.163194 Jan 29 03:48:49.187683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 330/657] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:49 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:49.648052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-eccc5e54-1338-456f-aaf3-05ca8f1167e4 req-81625dd8-24b2-435c-9a36-9cfe13fa1f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "name": "network-vif-plugged", "status": "completed", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:49.648052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:49.648052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:48:49.653201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-eccc5e54-1338-456f-aaf3-05ca8f1167e4 req-81625dd8-24b2-435c-9a36-9cfe13fa1f15 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:49.653671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-eccc5e54-1338-456f-aaf3-05ca8f1167e4 req-81625dd8-24b2-435c-9a36-9cfe13fa1f15 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:49.665099 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-eccc5e54-1338-456f-aaf3-05ca8f1167e4 req-81625dd8-24b2-435c-9a36-9cfe13fa1f15 service nova] Creating event network-vif-plugged:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:48:49.681461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-eccc5e54-1338-456f-aaf3-05ca8f1167e4 req-81625dd8-24b2-435c-9a36-9cfe13fa1f15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041205 Jan 29 03:48:49.682489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 328/658] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:50.024882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:50.025483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:50.031923 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:50.032472 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:50.033131 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:50.033566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:50.073315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-13ee6434-9b0a-42c0-9007-bcd7689ff343 req-5604ca6e-b75d-4c43-972f-23083de08950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13408461-7e63-4df9-b538-07d196e4fda8", "tag": "c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:50.076290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:50.076290 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:48:50.085003 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-13ee6434-9b0a-42c0-9007-bcd7689ff343 req-5604ca6e-b75d-4c43-972f-23083de08950 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:50.085628 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-13ee6434-9b0a-42c0-9007-bcd7689ff343 req-5604ca6e-b75d-4c43-972f-23083de08950 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:50.096568 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-13ee6434-9b0a-42c0-9007-bcd7689ff343 req-5604ca6e-b75d-4c43-972f-23083de08950 service nova] Creating event network-changed:c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1 for instance 13408461-7e63-4df9-b538-07d196e4fda8 on hv-cinder-82694 Jan 29 03:48:50.101222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-13ee6434-9b0a-42c0-9007-bcd7689ff343 req-5604ca6e-b75d-4c43-972f-23083de08950 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033733 Jan 29 03:48:50.102718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 329/659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:48:50.185886 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:50.193426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d22b0cc8-fdef-4bde-a785-c1e45900a620 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.172250 Jan 29 03:48:50.194034 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 331/660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:50 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:50.209126 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:50.209813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:50.215946 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:50.216386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:50.217151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:50.217581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:50.504495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:50.512069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-22932fcc-6c92-4a87-8314-908c8fd74133 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.306823 Jan 29 03:48:50.512715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 330/661] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:50 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:51.210987 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:51.211591 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:51.217853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:51.220310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:51.220310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:51.220310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:51.355103 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:51.362362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9999f590-9a5d-487a-9550-fa6b1fad98e7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1256 microversion: 2.1 time: 0.155274 Jan 29 03:48:51.362956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 332/662] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:51 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1256 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:51.529117 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:51.529727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:51.536058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:51.536506 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:51.537273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:51.537710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:51.683473 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:51.690748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-498aa52e-c613-4523-b882-8d2e893c0fe4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.165802 Jan 29 03:48:51.691310 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 331/663] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:51 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:52.379860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:52.380618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:52.386922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.387362 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.388128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.388585 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.533292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:52.540543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-49032712-97cc-4c65-924a-243a8712de32 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1440 microversion: 2.1 time: 0.164364 Jan 29 03:48:52.541103 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 333/664] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:52 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:52.557283 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:52.557899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:52.564097 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.564550 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.565324 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.565926 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.701052 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:52.707304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:52.708055 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:52.714906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.715538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.717988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ca7863c8-5a45-43b8-affa-20a9d6c99a9c tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1440 microversion: 2.1 time: 0.164060 Jan 29 03:48:52.718612 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 332/665] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:52 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:52.719019 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:52.720615 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:52.905911 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:52.913470 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5738e73a-125d-48b0-aea9-6a31736fa696 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.209954 Jan 29 03:48:52.914034 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 334/666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:52 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:53.930151 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:53.930765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:53.937297 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:53.937856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:53.938760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:53.939242 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:54.263293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:54.270933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-235258f7-c6db-460a-887f-7a6d7550f1c7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.344406 Jan 29 03:48:54.271415 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 333/667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:53 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:55.210639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-d5a4635a-d038-40d1-b8af-e699c29f46d7 req-db477bf1-0fab-44bf-9a00-6e22a4e51666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:55.210639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:55.210639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:55.210639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d5a4635a-d038-40d1-b8af-e699c29f46d7 req-db477bf1-0fab-44bf-9a00-6e22a4e51666 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:55.210639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d5a4635a-d038-40d1-b8af-e699c29f46d7 req-db477bf1-0fab-44bf-9a00-6e22a4e51666 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:55.218652 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-d5a4635a-d038-40d1-b8af-e699c29f46d7 req-db477bf1-0fab-44bf-9a00-6e22a4e51666 service nova] Creating event network-changed:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:48:55.223475 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-d5a4635a-d038-40d1-b8af-e699c29f46d7 req-db477bf1-0fab-44bf-9a00-6e22a4e51666 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029178 Jan 29 03:48:55.224257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 335/668] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:55.287817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:55.289048 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:55.299868 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:55.300320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:55.301124 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:55.302687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:55.587337 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:55.598444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cf193af6-6357-45bb-bc6a-1126e583f3bc tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.313933 Jan 29 03:48:55.599339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 334/669] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:55 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:55.979966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-d260e370-58e6-453a-9568-b8fc98e2c5d7 req-dd15ccb5-f10e-4141-b835-3cbb57666971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13408461-7e63-4df9-b538-07d196e4fda8", "name": "network-vif-plugged", "status": "completed", "tag": "c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:55.981560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:48:55.981560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:48:55.990309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d260e370-58e6-453a-9568-b8fc98e2c5d7 req-dd15ccb5-f10e-4141-b835-3cbb57666971 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:55.990309 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d260e370-58e6-453a-9568-b8fc98e2c5d7 req-dd15ccb5-f10e-4141-b835-3cbb57666971 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:56.000758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-d260e370-58e6-453a-9568-b8fc98e2c5d7 req-dd15ccb5-f10e-4141-b835-3cbb57666971 service nova] Creating event network-vif-plugged:c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1 for instance 13408461-7e63-4df9-b538-07d196e4fda8 on hv-cinder-82694 Jan 29 03:48:56.005680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-d260e370-58e6-453a-9568-b8fc98e2c5d7 req-dd15ccb5-f10e-4141-b835-3cbb57666971 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 Jan 29 03:48:56.006395 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 336/670] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:48:56.615333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:56.615936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:56.622176 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:56.622632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:56.623410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:56.623845 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:56.757112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:56.767178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-36726e94-94ba-4f5b-b0c3-9663ba86adf8 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.155414 Jan 29 03:48:56.767730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 335/671] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:56 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:57.490344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1930859545", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "ef6de4e4-05ee-42cc-80a7-a2f0b7a60e8a"}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:48:57.539267 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] validate_networks() for [('ef6de4e4-05ee-42cc-80a7-a2f0b7a60e8a', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:48:57.784706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:57.785342 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:57.791909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:57.792446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:57.793368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:57.793932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:57.893068 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:48:57.893490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:48:57.894235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:48:57.894638 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:48:57.895067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:48:57.903736 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:57.904281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:57.905093 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:57.905522 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:57.921548 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Getting quotas for project 7211c10bef7c491bbc0bae9b8223bb31. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:48:57.925695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Getting quotas for user 4241a03c166e459d8766196eef2d8cf1 and project 7211c10bef7c491bbc0bae9b8223bb31. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:48:57.929130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:57.936916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b2ba5f5e-ac4b-46e9-ab3f-9d8a85e95010 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1312 microversion: 2.1 time: 0.156004 Jan 29 03:48:57.937096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:48:57.937478 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 336/672] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:57 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:48:57.939419 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:48:58.061820 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-22836494-9a27-4141-a55c-55092c6a5625 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575938 Jan 29 03:48:58.062417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 337/673] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 29 03:48:58.072211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-16af52bc-977a-4f22-ad91-334b2ef87a31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:58.072776 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-16af52bc-977a-4f22-ad91-334b2ef87a31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:58.123939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-16af52bc-977a-4f22-ad91-334b2ef87a31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:58.130325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-16af52bc-977a-4f22-ad91-334b2ef87a31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1219 microversion: 2.1 time: 0.061889 Jan 29 03:48:58.130903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 337/674] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:58 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:58.953447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:58.954075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:58.960287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:58.963755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:58.963755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:58.963755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:59.091962 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:59.099173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5dd1b9ab-a434-4023-a4a5-44550cc9df2b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1496 microversion: 2.1 time: 0.149841 Jan 29 03:48:59.099731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 338/675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:58 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:48:59.148468 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:48:59.149073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:48:59.155608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:59.156138 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:59.156979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:48:59.157416 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:48:59.219377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:48:59.226908 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-34f53eae-cad0-4845-82f3-57070630a495 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1223 microversion: 2.1 time: 0.081974 Jan 29 03:48:59.231091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 338/676] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:48:59 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:00.134193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:00.134768 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:00.141352 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.141798 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.142601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.143031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.175158 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:49:00.243930 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:00.244549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:00.251368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.251822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.252608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.253102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.314565 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:00.322162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2cbe5e42-0255-434e-a895-99a94480e614 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1271 microversion: 2.1 time: 0.081786 Jan 29 03:49:00.330175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 339/677] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:00 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:00.540939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cb00dddd-f14d-4bed-a5f8-2e884bea98a2 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 204 len: 0 microversion: 2.1 time: 0.410194 Jan 29 03:49:00.541831 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 339/678] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:49:00 2022] DELETE /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:49:00.549917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:00.550553 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:00.556234 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.556681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.557460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:00.557894 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:00.765213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:00.774960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cbd7fd81-6bb5-486d-aa2d-87feec715521 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1502 microversion: 2.1 time: 0.228542 Jan 29 03:49:00.775814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 340/679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:00 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:01.340355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:01.341037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:01.347768 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:01.348206 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:01.348966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:01.349389 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:01.483809 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:01.491091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1249de67-d3eb-41fd-becc-58bd10cb7ffe tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.154809 Jan 29 03:49:01.491654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 340/680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:01 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:01.798532 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:01.799507 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:01.805840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:01.806331 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:01.807104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:01.807542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:01.976887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:01.984809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8b942e39-a63c-4219-b66a-a5d241e7c974 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1502 microversion: 2.1 time: 0.190026 Jan 29 03:49:01.985356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 341/681] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:01 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:02.053390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-54d598b6-e9b4-4b05-a790-96e77b65dd54 req-d6e0bef1-f1ee-43c5-be33-5887ba259e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165", "tag": "1a2191c4-101f-4ba2-9123-19fdef51bf4d"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:02.054999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:02.054999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:49:02.062561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-54d598b6-e9b4-4b05-a790-96e77b65dd54 req-d6e0bef1-f1ee-43c5-be33-5887ba259e41 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:02.063005 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-54d598b6-e9b4-4b05-a790-96e77b65dd54 req-d6e0bef1-f1ee-43c5-be33-5887ba259e41 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:02.075692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-54d598b6-e9b4-4b05-a790-96e77b65dd54 req-d6e0bef1-f1ee-43c5-be33-5887ba259e41 service nova] Creating event network-changed:1a2191c4-101f-4ba2-9123-19fdef51bf4d for instance 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 on hv-cinder-82694 Jan 29 03:49:02.080299 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-54d598b6-e9b4-4b05-a790-96e77b65dd54 req-d6e0bef1-f1ee-43c5-be33-5887ba259e41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030515 Jan 29 03:49:02.080896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 341/682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:02.508274 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:02.509057 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:02.526670 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:02.527296 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:02.528169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:02.529380 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:03.002147 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:03.002853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:03.008875 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:03.009320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:03.010099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:03.010560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:03.136534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:03.145917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-36e1a210-2018-4d58-a6e1-fcd222191373 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.641515 Jan 29 03:49:03.146733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 342/683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:02 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:03.158318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:03.165590 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c927ab50-db2c-404e-8333-4e1c49bfc7b7 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1502 microversion: 2.1 time: 0.167835 Jan 29 03:49:03.166173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 342/684] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:02 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:04.094902 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-c81c6be9-4484-4c12-a0b4-f7a073b2780d req-ae681798-bf49-4cd0-9a6d-1d4b51ea8ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13408461-7e63-4df9-b538-07d196e4fda8", "name": "network-vif-deleted", "tag": "c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:04.096441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:04.096441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:04.103655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-c81c6be9-4484-4c12-a0b4-f7a073b2780d req-ae681798-bf49-4cd0-9a6d-1d4b51ea8ca2 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.104093 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-c81c6be9-4484-4c12-a0b4-f7a073b2780d req-ae681798-bf49-4cd0-9a6d-1d4b51ea8ca2 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.115173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-c81c6be9-4484-4c12-a0b4-f7a073b2780d req-ae681798-bf49-4cd0-9a6d-1d4b51ea8ca2 service nova] Creating event network-vif-deleted:c0a0c54d-9369-4c7d-a4f5-eb71d4851bd1 for instance 13408461-7e63-4df9-b538-07d196e4fda8 on hv-cinder-82694 Jan 29 03:49:04.119944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-c81c6be9-4484-4c12-a0b4-f7a073b2780d req-ae681798-bf49-4cd0-9a6d-1d4b51ea8ca2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029176 Jan 29 03:49:04.120505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 343/685] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:04.163561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:04.164166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:04.173171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.173617 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.174416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.174845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.183025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:04.184907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:04.190956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.191403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.192266 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.192711 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.224086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.224534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.225129 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lazy-loading 'fault' on Instance uuid 13408461-7e63-4df9-b538-07d196e4fda8 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:49:04.270045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:04.274541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4961ff1f-61a4-4d42-be99-85d17ee2bc7d tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 200 len: 1302 microversion: 2.1 time: 0.095425 Jan 29 03:49:04.275107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 344/686] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:04 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:04.321433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:04.329319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-06557bb4-a614-49fb-b656-5eb35bdf883c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.170451 Jan 29 03:49:04.329878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 343/687] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:04 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:04.494172 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:04.495086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:04.500864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.501315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.502104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.502576 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.533047 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-99ef6aaa-743c-49fa-bd1b-155ef62ffffb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042404 Jan 29 03:49:04.533618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 345/688] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:49:04 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:49:04.590671 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:04.591257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:04.597735 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.598218 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.599015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.599436 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.623376 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:49:04.890234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b4d867fe-33c6-4da5-ba43-0eebb7f5e242 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 204 len: 0 microversion: 2.1 time: 0.302853 Jan 29 03:49:04.890818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 344/689] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:49:04 2022] DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:49:04.899040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:04.899689 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:04.905478 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.905924 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:04.906732 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:04.907171 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.038979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:05.046771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-22d3b8a2-f403-48a1-8801-02265108b266 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1674 microversion: 2.1 time: 0.151381 Jan 29 03:49:05.047327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 346/690] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:04 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:05.292314 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:05.293003 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 13408461-7e63-4df9-b538-07d196e4fda8] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:05.299787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.300231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.301003 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.301437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.314242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] HTTP exception thrown: Instance 13408461-7e63-4df9-b538-07d196e4fda8 could not be found. Jan 29 03:49:05.314818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Returning 404 to user: Instance 13408461-7e63-4df9-b538-07d196e4fda8 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:49:05.315607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7384bcea-5846-46a2-801e-c064b669d162 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8" status: 404 len: 111 microversion: 2.1 time: 0.027349 Jan 29 03:49:05.316137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 345/691] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:05 2022] GET /compute/v2.1/servers/13408461-7e63-4df9-b538-07d196e4fda8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:49:05.346351 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:05.346964 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:05.353122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.353574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.354392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.354836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.407658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1551664749", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "5fe69e09-472f-4f8c-8e21-fc6cbc9e2e6e"}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:05.459506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] validate_networks() for [('5fe69e09-472f-4f8c-8e21-fc6cbc9e2e6e', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:49:05.490063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:05.497495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0413dded-b205-42fa-8831-1f5930ff4788 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.154809 Jan 29 03:49:05.498059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 347/692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:05 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:05.784831 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:49:05.785243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:49:05.785710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:49:05.786108 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:49:05.786534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:49:05.794942 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.795381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.796185 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:05.796612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:05.812588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Getting quotas for project de38e16f36a046dea407a31c4a9e110a. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:49:05.816737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Getting quotas for user 62ada98da8824d88874d34ad4aa5dae1 and project de38e16f36a046dea407a31c4a9e110a. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:49:05.830699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:49:05.833001 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:49:05.964868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f4fca7c5-9756-4795-b6aa-bf140903b480 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561282 Jan 29 03:49:05.966143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 346/693] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:49:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 29 03:49:05.976394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-28d9e368-3fe3-4915-812e-044834087448 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:05.976997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-28d9e368-3fe3-4915-812e-044834087448 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:06.027669 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-28d9e368-3fe3-4915-812e-044834087448 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:06.035229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-28d9e368-3fe3-4915-812e-044834087448 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1214 microversion: 2.1 time: 0.062240 Jan 29 03:49:06.035452 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 348/694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:05 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:06.064162 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:06.064772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:06.070895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:06.071349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:06.072128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:06.072563 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:06.213999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:06.221557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ba518b47-e349-4271-8ac2-40ed6317cbe2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1674 microversion: 2.1 time: 0.161703 Jan 29 03:49:06.222119 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 347/695] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:06 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:06.513571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:06.514200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:06.520648 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:06.524864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:06.524864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:06.524864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:06.655632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:06.662737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-868bb007-0ef1-4f7a-b160-f415f60d6a9e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.153255 Jan 29 03:49:06.663293 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 349/696] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:06 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:07.051244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:07.051916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:07.058211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.058653 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.059427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.059860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.119804 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:07.127198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c689f27c-7e63-469c-bd0d-5545c60fb7b4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1210 microversion: 2.1 time: 0.079566 Jan 29 03:49:07.127758 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 348/697] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:07 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:07.238820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:07.239425 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:07.245251 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.245703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.246505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.246935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.405560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:07.412857 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-225716bc-928f-4167-96c6-951c556a133d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1674 microversion: 2.1 time: 0.177860 Jan 29 03:49:07.413631 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 350/698] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:07 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:07.680541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:07.690311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:07.690311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.690311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.690879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:07.691308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:07.839306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:07.846547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bd6068ab-5948-44fa-88ad-9c982c949f6d tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.170107 Jan 29 03:49:07.850538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 349/699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:07 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:08.145345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:08.146214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:08.152603 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.153060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.153883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.154584 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.262513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:08.270080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-98ccc963-db92-4e13-a1f5-6b6a2fee1bb4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1272 microversion: 2.1 time: 0.129682 Jan 29 03:49:08.270674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 351/700] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:08 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:08.430083 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:08.430735 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:08.436887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.437327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.438093 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.438553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.505709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:08.513790 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8305b1ad-fde3-41d5-b9b1-c1728c839623 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1606 microversion: 2.1 time: 0.087258 Jan 29 03:49:08.514816 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 350/701] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:08 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1606 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:08.628715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-3449479f-d255-4ef4-8611-71372a3d032d req-35bebcf5-6d92-4e77-8796-5358fc5eede1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fc5079-1458-479d-b5b0-d0b0fb1e9235", "name": "network-vif-deleted", "tag": "b515e1c3-80c1-45a6-ac70-b260f4d4c858"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:08.630961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:08.630961 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:08.644613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-3449479f-d255-4ef4-8611-71372a3d032d req-35bebcf5-6d92-4e77-8796-5358fc5eede1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.645207 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-3449479f-d255-4ef4-8611-71372a3d032d req-35bebcf5-6d92-4e77-8796-5358fc5eede1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.661810 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-3449479f-d255-4ef4-8611-71372a3d032d req-35bebcf5-6d92-4e77-8796-5358fc5eede1 service nova] Creating event network-vif-deleted:b515e1c3-80c1-45a6-ac70-b260f4d4c858 for instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 on hv-cinder-82694 Jan 29 03:49:08.667242 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-3449479f-d255-4ef4-8611-71372a3d032d req-35bebcf5-6d92-4e77-8796-5358fc5eede1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045013 Jan 29 03:49:08.669000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 352/702] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:08.863881 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:08.864482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:08.870393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.870844 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:08.871622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:08.872054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.024520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:09.033130 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cb804ea1-4075-46a5-afef-da0f657ed4df tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.173092 Jan 29 03:49:09.033846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 351/703] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:08 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:09.288331 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:09.289673 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:09.297638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.298034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.298784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.299213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.533363 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:09.534727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:09.541235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.541984 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.543034 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.543680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.551527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:09.560082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6051c3d4-3eb7-458c-a25f-a0fa78d7ab77 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.276173 Jan 29 03:49:09.560907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 353/704] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:09 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:09.588704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.589289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.589836 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lazy-loading 'fault' on Instance uuid 45fc5079-1458-479d-b5b0-d0b0fb1e9235 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:49:09.629562 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:09.637014 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-178612de-5ac9-4d70-ba89-37b34f2f453f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 200 len: 1328 microversion: 2.1 time: 0.107283 Jan 29 03:49:09.637667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 352/705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:09 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:09.773945 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-9da4396d-3d08-4ed4-a3a7-8a51b188d482 req-6cf7010b-ac39-44b8-aa45-81939acf9c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165", "name": "network-vif-plugged", "status": "completed", "tag": "1a2191c4-101f-4ba2-9123-19fdef51bf4d"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:09.775558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:09.775558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:09.783824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-9da4396d-3d08-4ed4-a3a7-8a51b188d482 req-6cf7010b-ac39-44b8-aa45-81939acf9c40 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:09.784977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-9da4396d-3d08-4ed4-a3a7-8a51b188d482 req-6cf7010b-ac39-44b8-aa45-81939acf9c40 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:09.795496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-9da4396d-3d08-4ed4-a3a7-8a51b188d482 req-6cf7010b-ac39-44b8-aa45-81939acf9c40 service nova] Creating event network-vif-plugged:1a2191c4-101f-4ba2-9123-19fdef51bf4d for instance 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 on hv-cinder-82694 Jan 29 03:49:09.800179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-9da4396d-3d08-4ed4-a3a7-8a51b188d482 req-6cf7010b-ac39-44b8-aa45-81939acf9c40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031494 Jan 29 03:49:09.800764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 354/706] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:10.049562 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:10.050409 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:10.056592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.057044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.057832 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.058305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.197181 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:10.204488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5a9ce28e-6d4f-4d0b-9b1d-8a5dd5f91890 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.158637 Jan 29 03:49:10.205044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 353/707] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:10 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:10.577196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:10.577887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:10.583934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.584384 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.585158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.585599 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.655742 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:10.656269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:10.662235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.662679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.663452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.663884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.677716 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. Jan 29 03:49:10.678556 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:49:10.679379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-108a9fe8-b2e2-4c85-8990-b4b536242528 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 404 len: 111 microversion: 2.1 time: 0.028024 Jan 29 03:49:10.679925 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 354/708] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:10 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 03:49:10.687927 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6daf0220-bf64-450d-8d0d-5101c7d353fd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '.version_select at 0x7f45012f7dc0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:10.760107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6daf0220-bf64-450d-8d0d-5101c7d353fd tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150490258" status: 202 len: 0 microversion: 2.1 time: 0.075071 Jan 29 03:49:10.764778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 355/709] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jan 29 03:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150490258 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:49:10.769542 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a70fa2e3-f9eb-4c23-a845-2be48d4798eb req-32e2b33d-667d-4132-8cf8-82e7e4e3e426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b13eb9e-1a6f-4d70-bd28-26148b531921", "tag": "638af51f-b329-4348-a835-a5c74cefd83c"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:10.774937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:10.774937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:49:10.779829 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a70fa2e3-f9eb-4c23-a845-2be48d4798eb req-32e2b33d-667d-4132-8cf8-82e7e4e3e426 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:10.780421 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a70fa2e3-f9eb-4c23-a845-2be48d4798eb req-32e2b33d-667d-4132-8cf8-82e7e4e3e426 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:10.790803 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a70fa2e3-f9eb-4c23-a845-2be48d4798eb req-32e2b33d-667d-4132-8cf8-82e7e4e3e426 service nova] Creating event network-changed:638af51f-b329-4348-a835-a5c74cefd83c for instance 8b13eb9e-1a6f-4d70-bd28-26148b531921 on hv-cinder-82694 Jan 29 03:49:10.797618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a70fa2e3-f9eb-4c23-a845-2be48d4798eb req-32e2b33d-667d-4132-8cf8-82e7e4e3e426 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030677 Jan 29 03:49:10.797618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 356/710] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:11.079377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:11.087177 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ed7162ff-19e9-436c-91b7-e96d1e78dee1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.514081 Jan 29 03:49:11.097701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 355/711] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:10 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:11.221070 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:11.221766 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:11.228523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:11.228896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:11.229686 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:11.230118 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:11.436655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:11.444054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f9221c8d-5798-42af-b3ef-cfbcffd191b1 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1319 microversion: 2.1 time: 0.227021 Jan 29 03:49:11.444619 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 357/712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:11 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:11.609287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: .version_select at 0x7f4500a77ee0>, body: {"keypair": {"name": "tempest-keypair-9210671"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:11.623018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:49:11.627001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:49:12.004238 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:49:12.007765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:49:12.021120 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2099cf00-d8d2-4ab3-acf5-57f1442419d7 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2302 microversion: 2.1 time: 0.418709 Jan 29 03:49:12.021721 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 356/713] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Jan 29 03:49:11 2022] POST /compute/v2.1/os-keypairs => generated 2302 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:12.104728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:12.105364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:12.111701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:12.112135 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:12.112897 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:12.113321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:12.284012 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:12.291457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b9b9b44e-3f75-420b-8a01-574c7878019b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.190560 Jan 29 03:49:12.292034 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 358/714] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:12 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:12.461165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:12.461798 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:12.468153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:12.468598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:12.469365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:12.469792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:12.606957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:12.615566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-770dda57-2419-4e85-8104-e2f260181f14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1507 microversion: 2.1 time: 0.158305 Jan 29 03:49:12.616183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 357/715] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:12 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:13.309311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:13.310666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:13.316886 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:13.317331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:13.318113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:13.318570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:13.456693 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:13.465462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b2d45ff4-4fde-49b6-bcfd-76deb778d983 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.159314 Jan 29 03:49:13.466098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 359/716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:13 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:14.325216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1993999700", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b4e9710-b6c9-4002-b8a3-8aa9bf7336cb"}], "security_groups": [{"name": "tempest-securitygroup--1796842783"}], "key_name": "tempest-keypair-9210671", "user_data": "}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:14.431860 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] validate_networks() for [('4b4e9710-b6c9-4002-b8a3-8aa9bf7336cb', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:49:14.482928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:14.483571 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:14.489958 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:14.490427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:14.491201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:14.491626 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:14.627663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:14.635705 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-41f886d0-786e-4a56-96a4-d2158afe6959 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.157103 Jan 29 03:49:14.636503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 360/717] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:14 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:14.816956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:49:14.817476 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:49:14.817996 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:49:14.818499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:49:14.818899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:49:14.829038 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:14.829484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:14.830334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:14.832436 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:14.847112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:49:14.851103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Getting quotas for user b4f5dd0c0cc243caab91e9dce629a26f and project 0f6df9863d6a490a92b2f3c872aec541. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:49:14.862623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:49:14.864951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:49:14.988453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d66e6135-09ea-488a-b763-9428418c501b tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.667066 Jan 29 03:49:14.989016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 358/718] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:49:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:49:14.999113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b96bf066-dfb8-4e35-8ca4-276693c1635c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:14.999712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b96bf066-dfb8-4e35-8ca4-276693c1635c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:15.056842 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b96bf066-dfb8-4e35-8ca4-276693c1635c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:15.064013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b96bf066-dfb8-4e35-8ca4-276693c1635c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1235 microversion: 2.1 time: 0.068794 Jan 29 03:49:15.064579 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 361/719] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:14 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:15.653729 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:15.654986 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:15.661483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:15.662026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:15.662836 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:15.663263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:15.796547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-3da2699a-d656-47a6-bb69-97f5b5b7135e req-494b0014-7676-477c-b598-3a7dbb63f3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b13eb9e-1a6f-4d70-bd28-26148b531921", "name": "network-vif-plugged", "status": "completed", "tag": "638af51f-b329-4348-a835-a5c74cefd83c"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:15.800391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:15.800391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:49:15.808448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:15.809460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3da2699a-d656-47a6-bb69-97f5b5b7135e req-494b0014-7676-477c-b598-3a7dbb63f3de service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:15.809960 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3da2699a-d656-47a6-bb69-97f5b5b7135e req-494b0014-7676-477c-b598-3a7dbb63f3de service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:15.815902 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a0ac3772-8b9c-413e-a6c9-f4b465523c1e tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.165827 Jan 29 03:49:15.816484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 359/720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:15 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:15.820772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-3da2699a-d656-47a6-bb69-97f5b5b7135e req-494b0014-7676-477c-b598-3a7dbb63f3de service nova] Creating event network-vif-plugged:638af51f-b329-4348-a835-a5c74cefd83c for instance 8b13eb9e-1a6f-4d70-bd28-26148b531921 on hv-cinder-82694 Jan 29 03:49:15.826844 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-3da2699a-d656-47a6-bb69-97f5b5b7135e req-494b0014-7676-477c-b598-3a7dbb63f3de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Jan 29 03:49:15.827872 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 362/721] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:16.081114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:16.081649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:16.087732 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:16.091987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:16.091987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:16.091987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:16.150288 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:16.158203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cedc2d97-0d12-417f-8017-dcae1403350d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1239 microversion: 2.1 time: 0.080835 Jan 29 03:49:16.158865 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 360/722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:16 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:16.833248 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:16.833957 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:16.840433 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:16.840918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:16.841707 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:16.842154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:16.978318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:16.986278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-3e6b091b-d301-4cff-9659-d84d34e9430b tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1314 microversion: 2.1 time: 0.156975 Jan 29 03:49:16.986870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 363/723] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:16 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:17.175489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:17.176000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:17.182247 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:17.182760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:17.183542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:17.183978 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:17.365992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:17.373571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b2e2b264-648a-46ca-92e5-fb8a54642cb1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1287 microversion: 2.1 time: 0.201863 Jan 29 03:49:17.374154 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 361/724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:17 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1287 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:18.003807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:18.004437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:18.016443 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:18.017005 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:18.017856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:18.018964 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:18.232073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:18.241414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-06cb9281-83fc-4750-bc2f-59f6a1567d44 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1498 microversion: 2.1 time: 0.241462 Jan 29 03:49:18.242064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 364/725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:17 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:18.391178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:18.391796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:18.398361 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:18.398819 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:18.399605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:18.400044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:18.606347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:18.614281 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c7382771-30b9-4533-88c0-291893c25605 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.227397 Jan 29 03:49:18.614843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 362/726] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:18 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:19.382707 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:19.383271 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:19.389956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.390734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.391503 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.391934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.420276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:49:19.501122 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-40941901-7a87-44b2-a845-277dbec5ac2e req-1bea6439-5e4c-4f4d-973d-f0210d04ed04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ffc873-aeb1-4085-a255-91347b2b62d9", "tag": "81d36aaf-b68e-47ba-968b-5057a5b62067"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:19.504292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:19.504292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:19.512020 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-40941901-7a87-44b2-a845-277dbec5ac2e req-1bea6439-5e4c-4f4d-973d-f0210d04ed04 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.512456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-40941901-7a87-44b2-a845-277dbec5ac2e req-1bea6439-5e4c-4f4d-973d-f0210d04ed04 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.524882 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-40941901-7a87-44b2-a845-277dbec5ac2e req-1bea6439-5e4c-4f4d-973d-f0210d04ed04 service nova] Creating event network-changed:81d36aaf-b68e-47ba-968b-5057a5b62067 for instance 61ffc873-aeb1-4085-a255-91347b2b62d9 on hv-cinder-82694 Jan 29 03:49:19.536090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-40941901-7a87-44b2-a845-277dbec5ac2e req-1bea6439-5e4c-4f4d-973d-f0210d04ed04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039079 Jan 29 03:49:19.536793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 363/727] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:19.632642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:19.633610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:19.640574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.641145 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.642226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.642940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.741301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-467264c1-fdf4-47fc-ac3d-52acf15dafc4 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 204 len: 0 microversion: 2.1 time: 0.362314 Jan 29 03:49:19.741918 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 365/728] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:49:19 2022] DELETE /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:49:19.752860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:19.753596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:19.759426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.759894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.760654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:19.761079 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:19.910268 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:19.920154 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0843ddb7-2899-4e1f-b5ad-882218681be1 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1504 microversion: 2.1 time: 0.173412 Jan 29 03:49:19.920741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 366/729] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:19 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:19.932666 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:19.940027 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-de977aba-207d-4444-a76e-53ac086ca4a8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.311452 Jan 29 03:49:19.940590 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 364/730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:19 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:20.937146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:20.937745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:20.943913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:20.944355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:20.945114 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:20.945541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:20.956386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:20.956992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:20.963189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:20.963654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:20.964418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:20.964849 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:21.086459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:21.094146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-90588219-a4a0-42e3-a842-0a616573471f tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1504 microversion: 2.1 time: 0.161251 Jan 29 03:49:21.094711 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 367/731] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:20 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:21.106585 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:21.116382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d37b609f-f02b-43c9-84b7-546f69d0b6b4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.163429 Jan 29 03:49:21.117110 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 365/732] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:20 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:22.110706 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:22.111305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:22.117378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:22.117820 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:22.118618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:22.119055 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:22.134314 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:22.137067 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:22.144611 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:22.145060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:22.145844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:22.146305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:22.259845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:22.267452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-08c6b930-7965-4269-b1c1-94ae0fa11820 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1504 microversion: 2.1 time: 0.160351 Jan 29 03:49:22.269511 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 368/733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:22 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:22.304037 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:22.311638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-56d01750-7164-4f61-9579-24d9e3654b3a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.180828 Jan 29 03:49:22.318224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 366/734] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:22 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:22.391939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-7f9291aa-ac8f-42df-a0fb-21c91f86226e req-7b86bbb0-c3df-47fb-9ec7-f37ef3d5d76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b13eb9e-1a6f-4d70-bd28-26148b531921", "name": "network-vif-deleted", "tag": "638af51f-b329-4348-a835-a5c74cefd83c"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:22.393746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:22.393746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:49:22.400576 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-7f9291aa-ac8f-42df-a0fb-21c91f86226e req-7b86bbb0-c3df-47fb-9ec7-f37ef3d5d76f service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:22.401080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-7f9291aa-ac8f-42df-a0fb-21c91f86226e req-7b86bbb0-c3df-47fb-9ec7-f37ef3d5d76f service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:22.412379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-7f9291aa-ac8f-42df-a0fb-21c91f86226e req-7b86bbb0-c3df-47fb-9ec7-f37ef3d5d76f service nova] Creating event network-vif-deleted:638af51f-b329-4348-a835-a5c74cefd83c for instance 8b13eb9e-1a6f-4d70-bd28-26148b531921 on hv-cinder-82694 Jan 29 03:49:22.417456 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-7f9291aa-ac8f-42df-a0fb-21c91f86226e req-7b86bbb0-c3df-47fb-9ec7-f37ef3d5d76f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029169 Jan 29 03:49:22.418089 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 369/735] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:23.285495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:23.286153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:23.292423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.292873 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.293652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.294094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.329026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.329234 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.329604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lazy-loading 'fault' on Instance uuid 8b13eb9e-1a6f-4d70-bd28-26148b531921 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:49:23.332162 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:23.334067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:23.350845 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.351356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.352173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.352607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.376184 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ada98da8824d88874d34ad4aa5dae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de38e16f36a046dea407a31c4a9e110a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:23.383674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-107f60d7-e306-4b03-8c01-5b6b5ce423b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 200 len: 1304 microversion: 2.1 time: 0.102214 Jan 29 03:49:23.384249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 367/736] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:23 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:23.497439 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:23.505474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a27ff10a-66a5-4872-a223-64d3605271b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.178500 Jan 29 03:49:23.506079 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 370/737] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:23 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:23.876512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:23.877073 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:23.883004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.883444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.884252 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:23.884693 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:23.912713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lazy-loading 'flavor' on Instance uuid 22400b6d-3511-472c-a8d5-7ef6b31a4733 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:49:24.410101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:24.410716 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] [instance: 8b13eb9e-1a6f-4d70-bd28-26148b531921] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:24.417211 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.417651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.418480 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.418909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.432726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] HTTP exception thrown: Instance 8b13eb9e-1a6f-4d70-bd28-26148b531921 could not be found. Jan 29 03:49:24.433330 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] Returning 404 to user: Instance 8b13eb9e-1a6f-4d70-bd28-26148b531921 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:49:24.434157 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ad80c779-1569-4f60-9497-81cdb0b4a1b5 tempest-VolumesActionsTest-821716960 tempest-VolumesActionsTest-821716960-project] 10.222.0.16 "GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921" status: 404 len: 111 microversion: 2.1 time: 0.027737 Jan 29 03:49:24.434689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 371/738] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:24 2022] GET /compute/v2.1/servers/8b13eb9e-1a6f-4d70-bd28-26148b531921 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 03:49:24.522797 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:24.523422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:24.530394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.530849 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.531630 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.532059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.628355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-46482b50-e93a-40cd-8270-0ff37da5136b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/action" status: 202 len: 0 microversion: 2.20 time: 0.755893 Jan 29 03:49:24.629402 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 368/739] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Jan 29 03:49:23 2022] POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:49:24.641099 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:24.642196 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:24.648936 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.651805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.651805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:24.651805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:24.672452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:24.680187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8cbea322-15eb-4e07-8e8b-be1d18020aab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.161043 Jan 29 03:49:24.680753 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 372/740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:24 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:24.792934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:24.802546 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:24.806746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:24.806746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c555fb32-b609-4d01-9b43-165f49e19054 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.171132 Jan 29 03:49:24.806746 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 369/741] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:24 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:25.699550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:25.700878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:25.707951 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:25.708462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:25.709314 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:25.709814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:25.817064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-688ee6f6-1da8-48ba-bced-84b813946ada req-6671b2cd-b528-4edd-ad61-e79e04f37bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ffc873-aeb1-4085-a255-91347b2b62d9", "name": "network-vif-plugged", "status": "completed", "tag": "81d36aaf-b68e-47ba-968b-5057a5b62067"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:25.818781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:25.818781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:25.826432 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-688ee6f6-1da8-48ba-bced-84b813946ada req-6671b2cd-b528-4edd-ad61-e79e04f37bc5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:25.831960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-688ee6f6-1da8-48ba-bced-84b813946ada req-6671b2cd-b528-4edd-ad61-e79e04f37bc5 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:25.837968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-688ee6f6-1da8-48ba-bced-84b813946ada req-6671b2cd-b528-4edd-ad61-e79e04f37bc5 service nova] Creating event network-vif-plugged:81d36aaf-b68e-47ba-968b-5057a5b62067 for instance 61ffc873-aeb1-4085-a255-91347b2b62d9 on hv-cinder-82694 Jan 29 03:49:25.843215 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-688ee6f6-1da8-48ba-bced-84b813946ada req-6671b2cd-b528-4edd-ad61-e79e04f37bc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029293 Jan 29 03:49:25.843803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 370/742] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:25.849009 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:25.849874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:25.856033 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:25.858660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:25.858660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:25.858660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:25.866794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:25.873997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4d0ba609-70f3-4a4a-ad53-0da89db2a0ab tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.178204 Jan 29 03:49:25.874665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 373/743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:25 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:26.005917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:26.013893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:26.015518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:26.016677 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2baeb332-d8a0-4b6f-a2c5-934b055ca348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.171523 Jan 29 03:49:26.017313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 371/744] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:25 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:26.891099 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:26.891694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:26.898091 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:26.898561 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:26.899327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:26.899755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:27.027784 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:27.037842 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9ce7f76c-3ed1-43c6-9668-6bb45124e984 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.150492 Jan 29 03:49:27.038603 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 374/745] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:26 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:27.132665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:27.133267 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:27.138920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:27.139912 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:27.140676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:27.141108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:27.271859 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:27.279797 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:27.281284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:27.282453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-12487824-393b-4d2e-badb-28ae3567a5a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.251186 Jan 29 03:49:27.283004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 372/746] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:27 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:28.054658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:28.055233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:28.061454 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:28.061891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:28.062677 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:28.063105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:28.195772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:28.203344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-58fefc10-8089-4d7b-ac87-61ef837a8c6d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.152334 Jan 29 03:49:28.203891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 375/747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:28 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:28.301499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:28.302113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:28.308394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:28.308791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:28.309566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:28.310008 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:28.444046 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:28.451710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:28.453708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:28.454904 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c24b3d85-975d-4c28-9870-2fe61b59b282 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.157109 Jan 29 03:49:28.455472 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 373/748] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:28 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:29.219657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:29.220321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:29.226576 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:29.227020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:29.227796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:29.228239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:29.356847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:29.364622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f09bd132-d22b-4ee1-b3af-9452bba4428a tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.149222 Jan 29 03:49:29.365190 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 376/749] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:29 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:29.472770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:29.473382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:29.479734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:29.480187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:29.480970 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:29.481413 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:29.610745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:29.618486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:29.620080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:29.621245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dbead17c-5772-410d-b7e5-31ad93325787 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.152191 Jan 29 03:49:29.621826 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 374/750] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:29 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:30.381185 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:30.381713 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:30.387933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:30.388374 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:30.389134 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:30.389850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:30.520073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:30.527186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0113230e-0106-4630-9342-0c0b7d7cae9f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1361 microversion: 2.1 time: 0.149715 Jan 29 03:49:30.527737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 377/751] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:30 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:30.639238 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:30.639783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:30.646445 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:30.646888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:30.647657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:30.648092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:30.789232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:30.797683 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:30.799214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:30.800366 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bb630398-363e-43e4-b283-87e4cc9f4962 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.164968 Jan 29 03:49:30.801113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 375/752] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:30 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:31.544558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:31.545088 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:31.552821 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.553272 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.554049 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.554528 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.693929 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:31.703393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e121abac-17af-40c5-b4c6-7126dfb574d9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1546 microversion: 2.1 time: 0.162595 Jan 29 03:49:31.715712 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 378/753] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:31 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:49:31.725595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:31.726183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:31.733112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.733653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.734653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.735447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.819104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:31.820051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:31.826780 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.828072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.829782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:31.830438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:31.831977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-90126330-9005-4a13-afca-5594ffa2bcf4 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110118 Jan 29 03:49:31.832700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 376/754] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Jan 29 03:49:31 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:32.334524 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bda4d48-34e3-4b65-8109-805cd3373a13", "device": "/dev/sdb"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:32.336203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:32.348209 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:32.349027 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:32.350349 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:32.351167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:32.374095 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:32.381934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:32.383451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:32.384622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cafd7079-4013-4c71-87d1-517c4643bc5c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.569250 Jan 29 03:49:32.391535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 379/755] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:31 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:33.054272 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7c9c098c-fe8a-431f-a83a-b5eeaa1ca70c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "POST /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723324 Jan 29 03:49:33.055341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 377/756] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:49:32 2022] POST /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:33.352664 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:33.359467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-3a75514e-b645-42ec-a260-d20839a58d19 req-1dd850bd-9d1d-45f7-a9b4-f483297e23b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ffc873-aeb1-4085-a255-91347b2b62d9", "tag": "81d36aaf-b68e-47ba-968b-5057a5b62067"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:33.360009 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:33.364191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:33.364191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:49:33.384048 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:33.384506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:33.389803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-3a75514e-b645-42ec-a260-d20839a58d19 req-1dd850bd-9d1d-45f7-a9b4-f483297e23b3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:33.390526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:33.391003 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:33.392398 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-3a75514e-b645-42ec-a260-d20839a58d19 req-1dd850bd-9d1d-45f7-a9b4-f483297e23b3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:33.415494 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-3a75514e-b645-42ec-a260-d20839a58d19 req-1dd850bd-9d1d-45f7-a9b4-f483297e23b3 service nova] Creating event network-changed:81d36aaf-b68e-47ba-968b-5057a5b62067 for instance 61ffc873-aeb1-4085-a255-91347b2b62d9 on hv-cinder-82694 Jan 29 03:49:33.431312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-3a75514e-b645-42ec-a260-d20839a58d19 req-1dd850bd-9d1d-45f7-a9b4-f483297e23b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076014 Jan 29 03:49:33.432775 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 378/757] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:33.438619 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:33.439492 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:33.445719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:33.446419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:33.447400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:33.447995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:33.617574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:33.627958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:33.629898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:33.631354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-110ba8ed-91b2-4bc3-8593-20b529fdf903 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.197323 Jan 29 03:49:33.632146 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 379/758] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:33 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:33.669979 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:33.684446 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0aaef393-c0a0-4526-89ff-9e48785125c1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1546 microversion: 2.1 time: 0.335058 Jan 29 03:49:33.695215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 380/759] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:33 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:34.650915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:34.651745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:34.658756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.659225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.660043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.660569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.782021 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:34.783491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:34.791063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.791622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.792602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.793173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.833070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:34.841175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:34.846297 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:34.847489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-943e56bd-ec6a-42d5-b530-45e5f6fae45d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.200721 Jan 29 03:49:34.848041 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 380/760] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:34 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:49:34.936260 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:34.944960 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1057ab36-814f-4f56-95f1-6e622c916b91 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1665 microversion: 2.1 time: 0.242256 Jan 29 03:49:34.948025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 381/761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:49:34 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1665 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:49:34.961019 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:34.961508 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:34.967340 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.967781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.968549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:34.968977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:34.993421 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-15cbbaa1-657a-4049-9f9e-f485f5e655cb tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/ips" status: 200 len: 145 microversion: 2.1 time: 0.036201 Jan 29 03:49:34.999521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:49:34 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:35.871585 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:35.872875 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:35.880230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:35.880971 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:35.882007 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:35.882606 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:36.031737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:36.039397 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:36.040882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:36.042010 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fb4c033c-8ce8-4483-8320-462b4afbe1e2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.174881 Jan 29 03:49:36.042587 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 382/763] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:35 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:49:36.691245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b809740-bd18-49e4-b223-504f84199a1d"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:36.693591 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:36.699322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:36.699664 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:36.700468 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:36.700898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:37.062006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:37.063674 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:37.071914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:37.072669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:37.073807 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:37.074457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:37.262222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:37.270927 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:37.276054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:37.276054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7b78bd48-8df9-4bcc-b6d2-a935791b0220 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.216776 Jan 29 03:49:37.276054 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 383/764] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:37 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:49:37.557637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-538d3887-29e8-4784-974f-3e8682c629a5 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870265 Jan 29 03:49:37.572327 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 382/765] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:49:36 2022] POST /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:38.291806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:38.292447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:38.299817 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:38.300502 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:38.301466 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:38.301900 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:38.472727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:38.488222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:38.489787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:38.490878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-993a1721-39ac-4f41-8541-5e51f62771c7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.203031 Jan 29 03:49:38.491614 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 384/766] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:38 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:39.509673 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:39.513602 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:39.520289 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:39.520743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:39.521531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:39.521968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:39.742995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:39.752590 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:39.765059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:39.767956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e14bbe8e-20ca-4d7d-8eb1-efa78491b655 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.262430 Jan 29 03:49:39.769252 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 383/767] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:39 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:40.795412 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:40.796028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:40.802245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:40.802723 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:40.803494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:40.803932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:40.954105 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:40.962059 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:40.963576 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:40.964764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ccaf87bc-a04d-4c65-8ee9-a8fbe139055f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1746 microversion: 2.20 time: 0.172992 Jan 29 03:49:40.965321 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 385/768] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:40 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:41.984870 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:41.985471 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:41.994053 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:41.996026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:41.996026 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:41.997951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:42.215576 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:42.236486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:42.241793 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:42.245359 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e97119dd-2d31-4791-bb98-40bce54d4e20 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1746 microversion: 2.20 time: 0.262724 Jan 29 03:49:42.247713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 384/769] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:41 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1746 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:43.270894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:43.272598 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:43.281508 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:43.282258 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:43.283356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:43.283822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:43.457938 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:43.466922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:43.468771 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:43.470742 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-565ddb0d-3a35-4ae1-b9d4-bfa24a4d17d2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1746 microversion: 2.20 time: 0.205030 Jan 29 03:49:43.481444 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 386/770] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:43 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1746 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:44.489683 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:44.490381 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:44.498768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:44.500877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:44.500877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:44.501243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:44.659570 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:44.670168 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:44.671939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:44.673825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-abcf4297-85a5-4ba4-995d-f9e82b2b155d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1746 microversion: 2.20 time: 0.188191 Jan 29 03:49:44.684354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 385/771] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:44 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1746 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:45.041543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-4ba029d4-44f4-4b41-936a-5db67a778d39 req-de36ff0a-4b25-4a1f-bf4b-f9c33dc8233b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "name": "network-vif-plugged", "status": "completed", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:45.048589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:49:45.048589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:49:45.053094 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-4ba029d4-44f4-4b41-936a-5db67a778d39 req-de36ff0a-4b25-4a1f-bf4b-f9c33dc8233b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:45.053699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-4ba029d4-44f4-4b41-936a-5db67a778d39 req-de36ff0a-4b25-4a1f-bf4b-f9c33dc8233b service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:45.067537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-4ba029d4-44f4-4b41-936a-5db67a778d39 req-de36ff0a-4b25-4a1f-bf4b-f9c33dc8233b service nova] Creating event network-vif-plugged:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:49:45.075356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-4ba029d4-44f4-4b41-936a-5db67a778d39 req-de36ff0a-4b25-4a1f-bf4b-f9c33dc8233b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Jan 29 03:49:45.076538 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 387/772] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:45.694986 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:45.694986 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:45.704179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:45.704902 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:45.705877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:45.706499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:45.877200 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:45.886788 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:45.888784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:45.890508 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c718752d-daf6-4295-aadb-493cfb81e945 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1746 microversion: 2.20 time: 0.202309 Jan 29 03:49:45.901779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 386/773] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:45 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:46.914749 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:46.915501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:46.922547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:46.923320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:46.924150 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:46.924589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:47.070663 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:47.091534 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:47.093794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:47.095452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c57743b4-d237-4173-ae84-d379eae98ce0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.190371 Jan 29 03:49:47.096221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 388/774] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:46 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:48.168610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:48.170512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:48.184827 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:48.185634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:48.186682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:48.187127 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:48.345613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:48.355910 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:48.357658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:48.358949 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-248dce28-2f42-481c-ade6-b71bfd408b1b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.194045 Jan 29 03:49:48.359995 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 387/775] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:48 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:49.381429 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:49.382850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:49.398422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:49.398984 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:49.399860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:49.408117 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:49.553741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:49.564726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:49.566518 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:49.567865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6b053a49-b4ea-49be-90ee-9493944d0d59 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.190902 Jan 29 03:49:49.580857 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 389/776] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:49 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:50.588521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:50.589114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:50.596300 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:50.606818 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:50.607731 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:50.608182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:50.763342 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:50.775261 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:50.776911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:50.778237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-08c210ca-b882-430d-b057-76753cc61881 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.193824 Jan 29 03:49:50.789442 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 388/777] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:50 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:51.599386 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:51.604980 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:51.612882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.613609 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.614607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.615324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.652058 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1276796d-203d-4cc7-9e25-4cd6cb61d57d tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056240 Jan 29 03:49:51.654163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 390/778] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:49:51 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:51.663571 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:51.664243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:51.671974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.672495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.673975 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.674507 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.706461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d3639d0b-94f0-44b9-a87d-33c161ddc9a1 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d" status: 200 len: 194 microversion: 2.1 time: 0.047230 Jan 29 03:49:51.714817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 389/779] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Jan 29 03:49:51 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:49:51.796680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:51.797277 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:51.811562 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.812439 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.813393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:51.814006 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:51.995697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:52.007018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:52.008894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:52.010190 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-41d7416c-bb56-4d2c-854e-8d8500c8dddc tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.217355 Jan 29 03:49:52.010909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 391/780] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:51 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:53.028514 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:53.029230 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:53.035933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:53.036485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:53.037389 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:53.038245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:53.198189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:53.206823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:53.229662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:53.229662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-edc34f65-5b5e-4b8b-88e9-ed481ead5671 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.184792 Jan 29 03:49:53.229662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 390/781] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:53 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:54.246537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:54.247824 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:54.256015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:54.256709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:54.260111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:54.260721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:54.433998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:54.445355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:54.452776 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:54.452776 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f204b78d-fe59-46c5-95fb-dd309d63fee4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.205525 Jan 29 03:49:54.452776 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 392/782] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:54 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:55.469006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:55.470915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:55.480055 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:55.481637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:55.481637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:55.482315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:55.634202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:55.642925 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:55.644778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:55.646031 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ba84e3db-9e17-412c-bd32-26ce462ee59e tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.180939 Jan 29 03:49:55.656933 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 391/783] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:55 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:49:56.531908 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37dce0b8-6464-4875-a96a-b4b7fd4e27d9"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:49:56.534366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:56.546513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:56.547707 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:56.550387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:56.551020 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:56.665528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:56.667131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:56.675835 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:56.676421 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:56.677984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:56.678564 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:57.031044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:57.038714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:57.040956 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:57.043271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-6bc3bc80-f20d-481b-8584-0fb54c57f4ac tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.382084 Jan 29 03:49:57.043886 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 392/784] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:56 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:49:58.064332 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:58.065285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:58.073180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:58.073968 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:58.074988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:58.082692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e64451b-6f3b-4fd8-a952-24815f493247 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "POST /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.554807 Jan 29 03:49:58.083941 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 393/785] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:49:56 2022] POST /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 194 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:49:58.084162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:58.285728 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:58.293343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:58.294882 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:58.296029 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-00ede69e-c3b1-4696-be7e-84e70929e04d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1741 microversion: 2.20 time: 0.236798 Jan 29 03:49:58.296587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 393/786] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:58 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:49:59.315197 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:49:59.316037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:49:59.322193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:59.322645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:59.326035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:49:59.326035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:49:59.465324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:59.474850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:59.476537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:49:59.477742 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-31f705af-ed48-4f1b-bdfb-982c6573fbb4 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1723 microversion: 2.20 time: 0.167235 Jan 29 03:49:59.478332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 394/787] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:49:59 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:00.495952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:00.496609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:00.503320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:00.504409 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:00.504542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:00.504977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:00.635261 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:00.644582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:00.646064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:00.647974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9d06c351-1a5c-4859-82d5-915b8a6120e6 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1723 microversion: 2.20 time: 0.155395 Jan 29 03:50:00.648737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 394/788] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:00 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:00.849267 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:00.849763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:00.855992 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:00.856441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:00.857212 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:00.857646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:00.934392 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lazy-loading 'services' on Instance uuid 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:50:01.156275 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6d0e7ebe-d9eb-4424-9b95-c4b09bd4bb69 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165/os-volume_attachments/6bda4d48-34e3-4b65-8109-805cd3373a13" status: 202 len: 0 microversion: 2.1 time: 0.310999 Jan 29 03:50:01.156893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 395/789] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:50:00 2022] DELETE /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165/os-volume_attachments/6bda4d48-34e3-4b65-8109-805cd3373a13 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:50:01.669147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:01.669688 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:01.676283 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:01.676736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:01.677519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:01.677955 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:01.811475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:01.819811 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:01.821309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:01.822487 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4bd39c39-40de-4041-a9e1-f1e40cfc12d1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1723 microversion: 2.20 time: 0.157314 Jan 29 03:50:01.823045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 395/790] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:01 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:02.150905 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-4ab9ba26-916e-4ace-b5ae-831e01c4a33a req-d7be3647-fcfd-4c93-adef-43944e48637e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "name": "network-vif-unplugged", "status": "completed", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:02.152695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:02.152695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:50:02.160544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-4ab9ba26-916e-4ace-b5ae-831e01c4a33a req-d7be3647-fcfd-4c93-adef-43944e48637e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:02.161092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-4ab9ba26-916e-4ace-b5ae-831e01c4a33a req-d7be3647-fcfd-4c93-adef-43944e48637e service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:02.171851 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-4ab9ba26-916e-4ace-b5ae-831e01c4a33a req-d7be3647-fcfd-4c93-adef-43944e48637e service nova] Creating event network-vif-unplugged:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:50:02.177525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-4ab9ba26-916e-4ace-b5ae-831e01c4a33a req-d7be3647-fcfd-4c93-adef-43944e48637e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152884 Jan 29 03:50:02.178104 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 396/791] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:02.840352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:02.840988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:02.847900 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:02.848428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:02.849202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:02.849638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:02.993242 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:03.001453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:03.002987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:03.004135 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c9d503c5-f447-4ca8-9698-645995dcf348 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1666 microversion: 2.20 time: 0.167559 Jan 29 03:50:03.004695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 396/792] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:02 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:03.022665 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1190d5d5-2260-4474-9f4b-84b7571284ad"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:03.023774 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:03.029765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:03.030261 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:03.031033 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:03.031458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:03.946306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-865e8769-ec88-498f-82e3-60f79f3c385c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.927898 Jan 29 03:50:03.946919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 397/793] 10.222.0.16 () {62 vars in 1363 bytes} [Sat Jan 29 03:50:03 2022] POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments => generated 188 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 29 03:50:04.057741 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:04.058259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:04.064394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.064838 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:04.065609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.066040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:04.568878 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b231a169-5744-422b-9547-a155527ed4a0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments/1190d5d5-2260-4474-9f4b-84b7571284ad" status: 202 len: 0 microversion: 2.20 time: 0.514741 Jan 29 03:50:04.569495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 397/794] 10.222.0.16 () {60 vars in 1456 bytes} [Sat Jan 29 03:50:04 2022] DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments/1190d5d5-2260-4474-9f4b-84b7571284ad => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:50:04.623618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:04.624176 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:04.632996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.633443 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:04.634245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.634679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:04.953847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-181b25b9-c6b0-4498-8261-5a6209a17e78 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/action" status: 202 len: 0 microversion: 2.20 time: 0.333864 Jan 29 03:50:04.954607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 398/795] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Jan 29 03:50:04 2022] POST /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:50:04.962206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:04.962814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:04.968645 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.969096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:04.969914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:04.970375 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:05.116613 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:05.124973 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:05.127148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:05.128372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-28cb211a-bdfa-4887-a74d-8ce6067eed5d tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1674 microversion: 2.20 time: 0.169868 Jan 29 03:50:05.128941 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 398/796] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:04 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:50:06.148110 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:06.148737 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:06.154825 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:06.155278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:06.156147 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:06.156581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:06.302600 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:06.311536 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:06.314674 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:06.315842 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-994e8d88-cfb6-4271-bfcb-a481486d39a2 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1674 microversion: 2.20 time: 0.172004 Jan 29 03:50:06.316402 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 399/797] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:06 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:06.645644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:06.646649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:06.653010 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:06.653503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:06.654370 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:06.654797 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:06.690466 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d12a3715-b11a-4966-a75b-2c07fec592f2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049246 Jan 29 03:50:06.691023 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 399/798] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:50:06 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:07.333949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:07.334661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:07.341018 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.341544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:07.342455 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.342959 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:07.481406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:07.501344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:07.502878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:07.504046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b6f8ea4d-bd53-4454-a466-73d2d32048f7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.174063 Jan 29 03:50:07.504908 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 400/799] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:07 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:07.537461 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:07.538490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:07.549253 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.550057 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:07.551625 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.552201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:07.577939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:50:07.901558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8ad083f4-40ab-4b3b-a386-2bbf406dec8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 204 len: 0 microversion: 2.1 time: 0.367506 Jan 29 03:50:07.902155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 400/800] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:50:07 2022] DELETE /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:50:07.910492 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:07.911096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:07.916902 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.917344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:07.918111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:07.918572 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:08.058458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:08.065545 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0495d6fb-98df-49a0-9982-1a4b756d6b0a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.159234 Jan 29 03:50:08.066120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 401/801] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:07 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:08.523627 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:08.524714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:08.541753 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:08.542332 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:08.543195 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:08.543700 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:08.738058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:08.746906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:08.750114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:08.750114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d30465c3-c235-4e8c-8b09-60b7fe6490b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.229980 Jan 29 03:50:08.750114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 401/802] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:08 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:09.083028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:09.083549 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:09.089765 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:09.090242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:09.091011 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:09.091444 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:09.243380 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:09.250771 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-05730c4a-afb7-4f55-b19a-6dddd622b363 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.171600 Jan 29 03:50:09.251429 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 402/803] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:09 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:09.769582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:09.773971 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:09.781079 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:09.781541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:09.782426 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:09.782855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:09.926416 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:09.934114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:09.935643 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:09.936796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-46e54a6f-aaa9-4fe4-93ef-5837b8e13941 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.172112 Jan 29 03:50:09.937351 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 402/804] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:09 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:10.268184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:10.268900 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:10.277106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:10.277693 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:10.278745 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:10.279340 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:10.442383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:10.449512 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9f44752c-35e6-46d2-9cda-274fb1dba37c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.185252 Jan 29 03:50:10.450069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 403/805] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:10 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:10.956943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:10.959233 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:10.966309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:10.967021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:10.967827 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:10.968269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:11.126321 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:11.135087 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:11.136587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:11.137756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bbd94474-6771-46d0-a38b-07bb9d1cd038 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.186118 Jan 29 03:50:11.149051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 403/806] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:10 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:11.466322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:11.466958 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:11.473700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:11.474239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:11.475062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:11.475524 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:11.618834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:11.627903 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-87366e6e-b0cb-4670-a38b-8408995f0c5c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.164732 Jan 29 03:50:11.638491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:11 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:12.156839 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:12.158548 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:12.164931 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:12.165379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:12.166194 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:12.166633 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:12.315437 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:12.323304 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:12.324807 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:12.325953 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-20012c17-1b37-4dd6-8181-0d23e06ffb4f tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.172879 Jan 29 03:50:12.326549 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 404/808] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:12 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:12.647188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:12.647755 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:12.654077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:12.654563 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:12.655343 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:12.655778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:12.817972 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:12.825488 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2838058d-3093-4757-85ae-cc9f763e7540 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.182286 Jan 29 03:50:12.826050 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 405/809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:12 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:13.407469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:13.408086 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:13.414312 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:13.414763 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:13.415539 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:13.415977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:13.564377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:13.572535 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:13.574304 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:13.575458 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-254bfc2f-4c83-4277-9430-82902471b5e7 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.172242 Jan 29 03:50:13.576001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 405/810] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:13 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:13.848207 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:13.850427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:13.860858 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:13.861719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:13.863139 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:13.863979 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:14.074032 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:14.083657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-265a0c61-b91f-4d5d-9be9-e4378cfd1ddd tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.242719 Jan 29 03:50:14.084240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 406/811] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:13 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:14.594109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:14.594762 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:14.601103 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:14.604655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:14.604655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:14.604655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:14.753140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:14.762111 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:14.763785 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:14.765341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2342f06d-6f45-45a3-9ef5-33183eb6e64a tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.174857 Jan 29 03:50:14.766587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 406/812] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:14 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:15.116125 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:15.117729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:15.122859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:15.123552 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:15.124514 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:15.125096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:15.274437 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:15.283896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b8085037-8986-4d21-8279-a9460d8d69a8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.172183 Jan 29 03:50:15.285319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 407/813] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:15 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:15.786386 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:15.787292 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:15.793850 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:15.794409 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:15.795212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:15.795649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:15.952006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:15.959838 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:15.961364 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:15.962547 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4cb54d65-e05c-40b5-9257-70a1696750c9 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.181520 Jan 29 03:50:15.963102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 407/814] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:15 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:16.300680 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:16.301297 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:16.307673 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:16.308117 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:16.308882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:16.309311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:16.472281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:16.479462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0b6cf5ee-0560-4222-8e4b-c7e5e1e0b508 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.182522 Jan 29 03:50:16.480087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 408/815] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:16 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:16.986025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:16.987206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:16.993758 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:16.994277 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:16.995109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:16.995560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:17.151697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:17.162406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:17.163960 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:17.165169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e6470e7b-4510-4623-8707-a3d5cda77678 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.183777 Jan 29 03:50:17.166079 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 408/816] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:16 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:17.496787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:17.497383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:17.503660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:17.504106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:17.504878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:17.505313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:17.635670 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:17.643583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d3fceb20-97eb-4096-ba7b-adf4492ae584 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.150587 Jan 29 03:50:17.644147 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 409/817] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:17 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:18.183069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:18.183694 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:18.190440 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:18.190888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:18.191661 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:18.192095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:18.324476 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:18.332231 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:18.333722 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:18.334922 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7c250f81-ddcf-4c5e-aa7f-f95b13b2f333 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.155664 Jan 29 03:50:18.335483 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 409/818] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:18 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:18.660120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:18.661310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:18.667547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:18.667997 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:18.668806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:18.669236 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:18.808966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:18.816322 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-938fa57a-ea55-4280-81ab-a6bad6e3da68 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1513 microversion: 2.1 time: 0.160408 Jan 29 03:50:18.816883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 410/819] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:18 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:19.352854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:19.353530 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:19.359757 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:19.360467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:19.361499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:19.361997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:19.561117 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:19.570718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:19.572239 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:19.573431 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-873cd737-65cf-40cb-b620-00fdc0862e22 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.224483 Jan 29 03:50:19.573985 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 410/820] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:19 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:19.757662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-bfae24c3-cdea-4e0c-928a-2a83b2d13fb3 req-c0c6b8b4-99c8-4734-ad28-bb109b2094a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165", "name": "network-vif-deleted", "tag": "1a2191c4-101f-4ba2-9123-19fdef51bf4d"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:19.762497 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:19.762497 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:50:19.770270 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-bfae24c3-cdea-4e0c-928a-2a83b2d13fb3 req-c0c6b8b4-99c8-4734-ad28-bb109b2094a4 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:19.770709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-bfae24c3-cdea-4e0c-928a-2a83b2d13fb3 req-c0c6b8b4-99c8-4734-ad28-bb109b2094a4 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:19.781300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-bfae24c3-cdea-4e0c-928a-2a83b2d13fb3 req-c0c6b8b4-99c8-4734-ad28-bb109b2094a4 service nova] Creating event network-vif-deleted:1a2191c4-101f-4ba2-9123-19fdef51bf4d for instance 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 on hv-cinder-82694 Jan 29 03:50:19.786332 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-bfae24c3-cdea-4e0c-928a-2a83b2d13fb3 req-c0c6b8b4-99c8-4734-ad28-bb109b2094a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095320 Jan 29 03:50:19.791123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 411/821] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:19.832503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:19.833112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:19.839077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:19.839531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:19.840308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:19.846265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:19.914155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:19.921566 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-33a22349-d3bb-4a68-84a0-082ceeb32cb8 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1471 microversion: 2.1 time: 0.092739 Jan 29 03:50:19.922155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 411/822] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:19 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:20.595454 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:20.596051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:20.602063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:20.602570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:20.603327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:20.603754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:20.738756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:20.747313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:20.748827 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:20.749975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a7eb83fe-2439-416b-8721-57814d69d14b tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.158648 Jan 29 03:50:20.750564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 412/823] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:20 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:20.938305 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:20.938914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:20.945096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:20.945545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:20.946344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:20.946780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:21.005923 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:21.013075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1c155164-faf4-4f63-872f-fdf1e6d018b4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1471 microversion: 2.1 time: 0.078333 Jan 29 03:50:21.013632 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 412/824] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:20 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1471 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:50:21.769250 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:21.769847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:21.776155 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:21.776597 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:21.777359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:21.777785 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:21.907451 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:21.915106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:21.916601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:21.917741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-51b9be45-8651-43bc-964a-5e305831477c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.153129 Jan 29 03:50:21.918329 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 413/825] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:21 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:22.031526 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:22.032091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:22.044505 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.044949 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.045745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.046207 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.109097 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:22.118841 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1914da4f-8754-4e64-b343-f09cf1b59040 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 200 len: 1304 microversion: 2.1 time: 0.091303 Jan 29 03:50:22.120733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 413/826] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:22 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:22.439764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:22.440250 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:22.445909 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.446381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.447193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.447627 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.476245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-71cc4738-af45-49b1-8578-e84a5bbc228c tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d" status: 200 len: 194 microversion: 2.1 time: 0.040231 Jan 29 03:50:22.476828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 414/827] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Jan 29 03:50:22 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:22.487060 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:22.494830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:22.494830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.494830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.494830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.495231 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.572759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lazy-loading 'services' on Instance uuid 61ffc873-aeb1-4085-a255-91347b2b62d9 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:50:22.774263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d35743b3-ba9e-4263-ac41-4c16b9beac34 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d" status: 202 len: 0 microversion: 2.1 time: 0.291375 Jan 29 03:50:22.774803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 414/828] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:50:22 2022] DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/8b809740-bd18-49e4-b223-504f84199a1d => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 29 03:50:22.935912 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:22.937065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:22.960320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.963477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:22.964532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:22.965038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:23.109083 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:23.116970 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:23.118481 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:23.119621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c2fa8eb3-7648-4123-ac2d-b7fe0c8344b0 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.187921 Jan 29 03:50:23.120177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 415/829] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:22 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:23.138419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:23.139123 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:23.146997 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:23.147454 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:23.148268 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:23.148710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:23.162345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] HTTP exception thrown: Instance 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 could not be found. Jan 29 03:50:23.162940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Returning 404 to user: Instance 3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:23.163778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-94cd60f4-3366-4fc6-94a3-39155301f4fb tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165" status: 404 len: 111 microversion: 2.1 time: 0.029516 Jan 29 03:50:23.164315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 415/830] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:23 2022] GET /compute/v2.1/servers/3a1f4ca1-c9cb-4ca4-bd13-274ce71f6165 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:24.139738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:24.140260 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:24.146769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:24.147214 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:24.148022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:24.148459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:24.278753 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:24.287215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:24.288690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:24.289825 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a6dc243d-c161-4d0a-ba02-38b5c09f89b1 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.153858 Jan 29 03:50:24.290407 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 416/831] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:24 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:25.307488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:25.308091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:25.315000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:25.315451 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:25.316226 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:25.316661 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:25.446996 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:25.454634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:25.456126 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:25.457271 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-08580756-a21c-4daa-a86c-3d77bc7be057 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.153459 Jan 29 03:50:25.457822 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 416/832] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:25 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:25.998818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-1b9428b2-2fa8-49c3-8ec1-ac464da7d7b3 req-85bf299a-0987-4760-82ed-d84273fd8a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "name": "network-vif-plugged", "status": "completed", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:26.003063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:26.003063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:50:26.007731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-1b9428b2-2fa8-49c3-8ec1-ac464da7d7b3 req-85bf299a-0987-4760-82ed-d84273fd8a52 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:26.008183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-1b9428b2-2fa8-49c3-8ec1-ac464da7d7b3 req-85bf299a-0987-4760-82ed-d84273fd8a52 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:26.019674 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-1b9428b2-2fa8-49c3-8ec1-ac464da7d7b3 req-85bf299a-0987-4760-82ed-d84273fd8a52 service nova] Creating event network-vif-plugged:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:50:26.024911 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-1b9428b2-2fa8-49c3-8ec1-ac464da7d7b3 req-85bf299a-0987-4760-82ed-d84273fd8a52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Jan 29 03:50:26.029025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 417/833] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:26.475077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:26.475681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:26.481881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:26.482366 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:26.483142 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:26.483577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:26.615817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:26.623659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:26.625147 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:26.626319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-da6fd70a-a8e7-492e-8962-d9772434c428 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.154948 Jan 29 03:50:26.626862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 417/834] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:26 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:27.646754 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:27.647458 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:27.660996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:27.663214 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:27.663692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:27.664196 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:27.805848 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:27.813806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:27.815834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:27.816962 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c24d92e8-b3dc-4444-a8b0-fa25bd25d32c tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.175154 Jan 29 03:50:27.817518 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 418/835] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:27 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:28.080184 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:28.080658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:28.086939 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.087388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.088161 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.088598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.120893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4e4bc067-d50a-460b-a67a-4b5083dd5302 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/37dce0b8-6464-4875-a96a-b4b7fd4e27d9" status: 200 len: 194 microversion: 2.1 time: 0.044318 Jan 29 03:50:28.121853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 418/836] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Jan 29 03:50:28 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/37dce0b8-6464-4875-a96a-b4b7fd4e27d9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:28.131871 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:28.132354 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:28.138214 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.138668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.139438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.139866 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.215970 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lazy-loading 'services' on Instance uuid 61ffc873-aeb1-4085-a255-91347b2b62d9 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:50:28.435539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-eae6b36f-6fc2-406c-968c-6957142ae3f8 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/37dce0b8-6464-4875-a96a-b4b7fd4e27d9" status: 202 len: 0 microversion: 2.1 time: 0.307755 Jan 29 03:50:28.436126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 419/837] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:50:28 2022] DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments/37dce0b8-6464-4875-a96a-b4b7fd4e27d9 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:50:28.835655 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:28.836257 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:28.842065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.842543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.843306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:28.843738 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:28.980783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:28.992146 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:28.993902 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:28.995144 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-50047a25-2c6a-4985-af66-fd7a2c7a8d75 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1732 microversion: 2.20 time: 0.163205 Jan 29 03:50:28.996456 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 419/838] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:28 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:30.015282 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:30.015974 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:30.022246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.022687 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.023445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.023873 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.157933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:30.166391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:30.167892 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:30.169080 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5d0594d3-1906-43f6-99d5-f62ae2bfdd53 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1719 microversion: 2.20 time: 0.158263 Jan 29 03:50:30.169594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 420/839] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:50:30 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:50:30.651363 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:30.652379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:30.658689 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.659141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.659920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.660355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.688501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7f417d1b-a466-42a2-b3b0-0cc9a6ec8386 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040797 Jan 29 03:50:30.689045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 420/840] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:50:30 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:50:30.787668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:30.788575 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:30.794344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.794793 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.795564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.796001 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.824313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0bba1327-73f6-4444-8de4-225593474d52 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040329 Jan 29 03:50:30.824856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 421/841] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:50:30 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:50:30.879094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:30.879528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:30.885178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.885652 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.886442 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:30.886874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:30.911235 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:50:31.186541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c05168fa-ed07-4131-8d41-9328e2ccc0a2 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 204 len: 0 microversion: 2.1 time: 0.311144 Jan 29 03:50:31.187044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 421/842] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:50:30 2022] DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:50:31.195523 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:31.196584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:31.202463 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:31.202916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:31.203687 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:31.204124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:31.419476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:31.419476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-dace1537-6e8a-47ba-ab5d-9d4ec8570b64 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1671 microversion: 2.1 time: 0.161223 Jan 29 03:50:31.419476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 422/843] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:31 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:32.379588 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:32.380320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:32.386583 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:32.387034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:32.387809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:32.388246 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:32.524187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:32.531621 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c45781cd-6dd1-4cc2-9bd6-15795b8e0ad9 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1671 microversion: 2.1 time: 0.156569 Jan 29 03:50:32.532186 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 422/844] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:32 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:33.548567 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:33.549290 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:33.555778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:33.556293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:33.557126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:33.557559 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:33.614389 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1128117596", "imageRef": "156bf377-ad44-448c-8995-5783f4457583", "flavorRef": "452", "networks": [{"uuid": "ef6de4e4-05ee-42cc-80a7-a2f0b7a60e8a"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:33.668406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] validate_networks() for [('ef6de4e4-05ee-42cc-80a7-a2f0b7a60e8a', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:50:33.689630 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:33.697471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-78e009f8-39d0-4bc1-a06a-70c074fc9a39 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1671 microversion: 2.1 time: 0.152726 Jan 29 03:50:33.698039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 423/845] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:33 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:34.040837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:50:34.041265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:50:34.041744 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:50:34.042169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:50:34.042616 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:50:34.051684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:34.052131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:34.052941 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:34.053372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:34.069569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Getting quotas for project 7211c10bef7c491bbc0bae9b8223bb31. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:50:34.073445 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Getting quotas for user 4241a03c166e459d8766196eef2d8cf1 and project 7211c10bef7c491bbc0bae9b8223bb31. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:50:34.083917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:50:34.086167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='156bf377-ad44-448c-8995-5783f4457583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:50:34.216054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5a34bf71-c7a0-4aad-aa41-430ab1c10f4c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605227 Jan 29 03:50:34.216847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 423/846] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 29 03:50:34.226703 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d2b8c13d-5389-4842-9ba4-381edcd45e5a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:34.227679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d2b8c13d-5389-4842-9ba4-381edcd45e5a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:34.281743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d2b8c13d-5389-4842-9ba4-381edcd45e5a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:34.288254 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d2b8c13d-5389-4842-9ba4-381edcd45e5a tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1219 microversion: 2.1 time: 0.065439 Jan 29 03:50:34.288871 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 424/847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:34 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:34.715684 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:34.716316 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:34.723056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:34.724265 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:34.724373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:34.724784 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:34.856785 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:34.864464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d5db3621-8599-4b97-ae5e-a6ece2e1f7b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1671 microversion: 2.1 time: 0.153018 Jan 29 03:50:34.865021 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 424/848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:34 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:35.304629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:35.305230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:35.311469 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:35.311919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:35.312690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:35.313123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:35.370879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:35.377870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-69a11000-6996-47d8-b376-6dde9f4e1693 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1223 microversion: 2.1 time: 0.077408 Jan 29 03:50:35.378587 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 425/849] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:35 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:35.881639 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:35.882313 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:35.888536 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:35.888996 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:35.892393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:35.892393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:36.033582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:36.041269 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0fa28de6-67e2-4638-add3-b8d936e78d3e tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1671 microversion: 2.1 time: 0.163790 Jan 29 03:50:36.041930 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 425/850] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:35 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:36.394934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:36.395528 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:36.401721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:36.402210 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:36.407344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:36.407344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:36.466490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:36.473721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9b1d4893-6051-419a-87d8-d4e07c730442 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1271 microversion: 2.1 time: 0.082736 Jan 29 03:50:36.480882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 426/851] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:36 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:37.058545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:37.059148 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:37.065698 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:37.066158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:37.066935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:37.067367 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:37.161295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:37.172096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-55364e23-26ce-4f53-aeda-ed61c260d902 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1603 microversion: 2.1 time: 0.117097 Jan 29 03:50:37.182501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 426/852] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:37 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1603 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:37.491016 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:37.492701 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:37.500968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:37.501431 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:37.502255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:37.503684 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:37.588087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:37.598474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-45d5bfca-4e8a-4c62-b3cf-c176ed4694ba tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1277 microversion: 2.1 time: 0.111353 Jan 29 03:50:37.600493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 427/853] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:37 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:37.654764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-5bffd342-4953-4e5a-bb9e-92ff1fdfe819 req-d7f16229-4be0-47cb-a7ac-d3b8f4288326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ffc873-aeb1-4085-a255-91347b2b62d9", "name": "network-vif-deleted", "tag": "81d36aaf-b68e-47ba-968b-5057a5b62067"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:37.656354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:37.656354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:50:37.663760 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-5bffd342-4953-4e5a-bb9e-92ff1fdfe819 req-d7f16229-4be0-47cb-a7ac-d3b8f4288326 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:37.664469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-5bffd342-4953-4e5a-bb9e-92ff1fdfe819 req-d7f16229-4be0-47cb-a7ac-d3b8f4288326 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:37.678917 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-5bffd342-4953-4e5a-bb9e-92ff1fdfe819 req-d7f16229-4be0-47cb-a7ac-d3b8f4288326 service nova] Creating event network-vif-deleted:81d36aaf-b68e-47ba-968b-5057a5b62067 for instance 61ffc873-aeb1-4085-a255-91347b2b62d9 on hv-cinder-82694 Jan 29 03:50:37.684075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-5bffd342-4953-4e5a-bb9e-92ff1fdfe819 req-d7f16229-4be0-47cb-a7ac-d3b8f4288326 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033184 Jan 29 03:50:37.684764 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 427/854] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:50:38.192847 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:38.193913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:38.204259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:38.204740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:38.205795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:38.207097 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:38.241189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:38.241640 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:38.242086 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lazy-loading 'fault' on Instance uuid 61ffc873-aeb1-4085-a255-91347b2b62d9 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:50:38.286681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f5dd0c0cc243caab91e9dce629a26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6df9863d6a490a92b2f3c872aec541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:38.294629 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-14ae5fdc-afba-4b41-82a2-dd6fac7562b0 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 200 len: 1325 microversion: 2.1 time: 0.107787 Jan 29 03:50:38.295646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 428/855] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:38 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 1325 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:38.621279 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:38.623218 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:38.631969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:38.632441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:38.633229 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:38.633665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:38.884771 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:38.892009 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-677a8960-a3da-4674-b7fb-6f6424426fec tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.277974 Jan 29 03:50:38.892838 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 428/856] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:38 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:39.311826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:39.312420 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:39.318710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:39.319157 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:39.319934 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:39.320368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:39.335584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. Jan 29 03:50:39.336331 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:39.337295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-93b12263-c876-4fd9-98af-7c347d582027 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 404 len: 111 microversion: 2.1 time: 0.029214 Jan 29 03:50:39.337841 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 429/857] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:39 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:39.346216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-24d6f23e-2173-4c75-b45c-6426981b2b78 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '.version_select at 0x7f45008f6c10>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:39.421938 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-24d6f23e-2173-4c75-b45c-6426981b2b78 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9210671" status: 202 len: 0 microversion: 2.1 time: 0.079354 Jan 29 03:50:39.424024 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 429/858] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Jan 29 03:50:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9210671 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:50:39.700790 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-8c90d159-918d-42a9-82af-79042cb9c765 req-ba5458f5-6d47-414d-a092-13b621a62065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852516d9-0773-4902-b732-954253533053", "tag": "68ddb4df-2cd2-4e16-b531-13f97e951b39"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:39.702398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:39.702398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:50:39.709668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-8c90d159-918d-42a9-82af-79042cb9c765 req-ba5458f5-6d47-414d-a092-13b621a62065 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:39.712929 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-8c90d159-918d-42a9-82af-79042cb9c765 req-ba5458f5-6d47-414d-a092-13b621a62065 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:39.720620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-8c90d159-918d-42a9-82af-79042cb9c765 req-ba5458f5-6d47-414d-a092-13b621a62065 service nova] Creating event network-changed:68ddb4df-2cd2-4e16-b531-13f97e951b39 for instance 852516d9-0773-4902-b732-954253533053 on hv-cinder-82694 Jan 29 03:50:39.725612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-8c90d159-918d-42a9-82af-79042cb9c765 req-ba5458f5-6d47-414d-a092-13b621a62065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028852 Jan 29 03:50:39.726228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 430/859] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:39.909178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:39.909950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:39.915710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:39.916153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:39.916962 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:39.917389 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:40.275045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:40.282408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3c60aa1e-59f6-4189-acc3-aa82318836a2 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.377390 Jan 29 03:50:40.285051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 430/860] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:39 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:41.301150 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:41.301843 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:41.308452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:41.308904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:41.309699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:41.310174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:41.444822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:41.452073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b64da9ff-77f7-4dbe-9b3d-4d447f487134 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.155552 Jan 29 03:50:41.452632 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 431/861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:41 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:42.468642 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:42.469855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:42.478944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:42.478944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:42.478944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:42.478944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:42.616735 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:42.623940 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-622d8d48-1957-4322-ac91-03a26f5d7a55 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.158962 Jan 29 03:50:42.624499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 431/862] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:42 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:43.035246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:43.035834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:43.042896 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.043539 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.044336 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.044759 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.057932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. Jan 29 03:50:43.058557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:43.059346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4cbd761c-33ef-4e4a-bed6-6b0086f2727f tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 404 len: 111 microversion: 2.1 time: 0.027775 Jan 29 03:50:43.059914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 432/863] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:50:43 2022] DELETE /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:43.067987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:43.068600 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 61ffc873-aeb1-4085-a255-91347b2b62d9] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:43.075743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.075743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.075743 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.076202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.089982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. Jan 29 03:50:43.090815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 61ffc873-aeb1-4085-a255-91347b2b62d9 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:43.091644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-154b3fac-daba-4356-bd41-c8e7662f68e6 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9" status: 404 len: 111 microversion: 2.1 time: 0.027318 Jan 29 03:50:43.092251 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 432/864] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:43 2022] GET /compute/v2.1/servers/61ffc873-aeb1-4085-a255-91347b2b62d9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:43.642394 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:43.643346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:43.649788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.650280 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.651014 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:43.651443 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:43.787939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:43.795641 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b148d634-c836-4edd-a210-547847736a4f tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.156878 Jan 29 03:50:43.804455 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 433/865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:43 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:44.369512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:44.369999 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:44.376165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.376610 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.377374 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.377885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.394659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. Jan 29 03:50:44.394659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:44.394659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-91bd5738-7483-4479-8e52-b9d0c95d9466 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 404 len: 111 microversion: 2.1 time: 0.027049 Jan 29 03:50:44.394659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 433/866] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:50:44 2022] DELETE /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:44.401274 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:44.401865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] [instance: 45fc5079-1458-479d-b5b0-d0b0fb1e9235] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:44.408285 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.408726 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.409496 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.409919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.424075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] HTTP exception thrown: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. Jan 29 03:50:44.424667 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] Returning 404 to user: Instance 45fc5079-1458-479d-b5b0-d0b0fb1e9235 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:44.425482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f83f36b6-0569-4b61-8b4d-de42a6702607 tempest-AttachVolumeTestJSON-508307086 tempest-AttachVolumeTestJSON-508307086-project] 10.222.0.16 "GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235" status: 404 len: 111 microversion: 2.1 time: 0.027877 Jan 29 03:50:44.426027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 434/867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:44 2022] GET /compute/v2.1/servers/45fc5079-1458-479d-b5b0-d0b0fb1e9235 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:44.508287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-d37619cc-57de-49dc-995d-b3b62bd531f5 req-b0e1356f-e824-4578-9ebd-c9856f048bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852516d9-0773-4902-b732-954253533053", "name": "network-vif-plugged", "status": "completed", "tag": "68ddb4df-2cd2-4e16-b531-13f97e951b39"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:44.511245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:50:44.511245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:50:44.522654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-d37619cc-57de-49dc-995d-b3b62bd531f5 req-b0e1356f-e824-4578-9ebd-c9856f048bc9 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.522654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-d37619cc-57de-49dc-995d-b3b62bd531f5 req-b0e1356f-e824-4578-9ebd-c9856f048bc9 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.536475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-d37619cc-57de-49dc-995d-b3b62bd531f5 req-b0e1356f-e824-4578-9ebd-c9856f048bc9 service nova] Creating event network-vif-plugged:68ddb4df-2cd2-4e16-b531-13f97e951b39 for instance 852516d9-0773-4902-b732-954253533053 on hv-cinder-82694 Jan 29 03:50:44.542716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-d37619cc-57de-49dc-995d-b3b62bd531f5 req-b0e1356f-e824-4578-9ebd-c9856f048bc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039710 Jan 29 03:50:44.544792 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 434/868] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:44.812933 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:44.814551 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:44.822531 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.824142 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:44.824358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:44.825237 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:45.276937 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:45.284515 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-53a2c0f4-2d27-4a3e-8fce-68d75d0698e4 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1319 microversion: 2.1 time: 0.475207 Jan 29 03:50:45.285166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 435/869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:44 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:46.303942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:46.304861 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:46.311460 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:46.311982 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:46.312823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:46.313273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:46.453478 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:50:46.460778 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-cf64aa66-4b67-4e92-aaba-d08094181115 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1507 microversion: 2.1 time: 0.162130 Jan 29 03:50:46.461393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 435/870] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:50:46 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:50:46.479418 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ca07aab-cb3b-4492-aaed-a5b0fbdd8448", "device": "/dev/sdb"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:46.479418 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:50:46.486082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:46.486675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:46.487653 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:50:46.488305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:50:47.281023 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2f74223f-e915-4a2e-bfca-1f3a0bb36d2e tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "POST /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807722 Jan 29 03:50:47.281906 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 436/871] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:50:46 2022] POST /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:50.541294 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d1380d66-c09c-4dc8-bed9-2a5ae3a05817 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Action: 'create', calling method: .version_select at 0x7f45008f61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1714042157", "metadata": {"Type": "work"}}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:51.264427 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d1380d66-c09c-4dc8-bed9-2a5ae3a05817 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.833977 Jan 29 03:50:51.265116 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 436/872] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jan 29 03:50:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 835 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 29 03:50:51.277075 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7dd06695-0352-4c69-8fe7-e2d03ee79d9a tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f4500930af0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:51.323772 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7dd06695-0352-4c69-8fe7-e2d03ee79d9a tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 200 len: 353 microversion: 2.1 time: 0.051046 Jan 29 03:50:51.324462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 437/873] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:51 2022] GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:52.336676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9ed5ab65-54fe-4624-bede-ebb1ffcce8e2 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f4500920670>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:52.380430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9ed5ab65-54fe-4624-bede-ebb1ffcce8e2 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 200 len: 354 microversion: 2.1 time: 0.048398 Jan 29 03:50:52.381503 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 437/874] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:52 2022] GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:52.392621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bfc498b3-8911-46b1-95b7-7cdd00f35d82 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f45009d0e50>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:52.437245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bfc498b3-8911-46b1-95b7-7cdd00f35d82 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 200 len: 354 microversion: 2.1 time: 0.048848 Jan 29 03:50:52.437797 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 438/875] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:52 2022] GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:52.449211 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-14fcea8b-d9b7-45c3-aa4a-faebc632b136 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f45009565e0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:52.665779 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-14fcea8b-d9b7-45c3-aa4a-faebc632b136 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 202 len: 0 microversion: 2.1 time: 0.220060 Jan 29 03:50:52.666580 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 438/876] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:50:52 2022] DELETE /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:50:52.674473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-27f26220-c17f-4931-b3eb-9971f4010514 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f450138d040>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:52.719208 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-27f26220-c17f-4931-b3eb-9971f4010514 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 200 len: 353 microversion: 2.1 time: 0.048324 Jan 29 03:50:52.719763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 439/877] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:52 2022] GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:50:53.731854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-35784e8c-6880-4d3e-8b9e-a2384a477a50 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Calling method '.version_select at 0x7f45008f6a60>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:53.757687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-35784e8c-6880-4d3e-8b9e-a2384a477a50 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] HTTP exception thrown: Volume 549fce4f-6978-40f8-98c3-31db843a8dc7 could not be found. Jan 29 03:50:53.758357 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-35784e8c-6880-4d3e-8b9e-a2384a477a50 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] Returning 404 to user: Volume 549fce4f-6978-40f8-98c3-31db843a8dc7 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:53.759212 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-35784e8c-6880-4d3e-8b9e-a2384a477a50 tempest-VolumesGetTestJSON-1587387460 tempest-VolumesGetTestJSON-1587387460-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7" status: 404 len: 109 microversion: 2.1 time: 0.031499 Jan 29 03:50:53.759740 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 439/878] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:53 2022] GET /compute/v2.1/os-volumes/549fce4f-6978-40f8-98c3-31db843a8dc7 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:55.793151 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9723ab36-792f-4c1a-bc87-71926f5e2054 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Action: 'create', calling method: .version_select at 0x7f45009bd4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2038364217", "metadata": {"Type": "work"}}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:55.794631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9723ab36-792f-4c1a-bc87-71926f5e2054 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.795415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9723ab36-792f-4c1a-bc87-71926f5e2054 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.113356 Jan 29 03:50:55.795956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 440/879] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jan 29 03:50:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:50:55.806189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-356da914-c121-4e6b-b50f-acd76aaf1556 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Action: 'create', calling method: .version_select at 0x7f45008f6670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1274336881", "metadata": {"Type": "work"}}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:55.807557 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-356da914-c121-4e6b-b50f-acd76aaf1556 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.808531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-356da914-c121-4e6b-b50f-acd76aaf1556 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007455 Jan 29 03:50:55.809049 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 440/880] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jan 29 03:50:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:50:55.817393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9790a790-c2c2-4476-b751-cedcb9f7f01c tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Action: 'create', calling method: .version_select at 0x7f4500a1e550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1579552538", "metadata": {"Type": "work"}}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:50:55.819620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9790a790-c2c2-4476-b751-cedcb9f7f01c tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.820395 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9790a790-c2c2-4476-b751-cedcb9f7f01c tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006634 Jan 29 03:50:55.820888 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 441/881] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jan 29 03:50:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:50:55.837404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a55471e6-f09d-48ef-a7bf-df1d0fb57b77 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Calling method '.version_select at 0x7f4500ba4ca0>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:55.864605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-a55471e6-f09d-48ef-a7bf-df1d0fb57b77 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] HTTP exception thrown: Volume tempest-invalid-1904161814 could not be found. Jan 29 03:50:55.864605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a55471e6-f09d-48ef-a7bf-df1d0fb57b77 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 404 to user: Volume tempest-invalid-1904161814 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.864605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a55471e6-f09d-48ef-a7bf-df1d0fb57b77 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1904161814" status: 404 len: 99 microversion: 2.1 time: 0.030697 Jan 29 03:50:55.865578 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 441/882] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Jan 29 03:50:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1904161814 => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 29 03:50:55.874168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fc08de08-5a4f-4f00-993c-00a67592a8a3 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003467 Jan 29 03:50:55.874661 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 442/883] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Jan 29 03:50:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 29 03:50:55.883839 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1c4e7699-0765-456f-a932-5fc61bb1d723 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004860 Jan 29 03:50:55.884331 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 442/884] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Jan 29 03:50:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 29 03:50:55.899477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a9c588b3-362a-4141-9f8b-b7a90612914f tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Calling method '.version_select at 0x7f4501288ca0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:55.918031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-a9c588b3-362a-4141-9f8b-b7a90612914f tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] HTTP exception thrown: Volume a71fc3a9-8c80-426f-ac76-0890db6ac652 could not be found. Jan 29 03:50:55.918656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a9c588b3-362a-4141-9f8b-b7a90612914f tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 404 to user: Volume a71fc3a9-8c80-426f-ac76-0890db6ac652 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.919466 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a9c588b3-362a-4141-9f8b-b7a90612914f tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a71fc3a9-8c80-426f-ac76-0890db6ac652" status: 404 len: 109 microversion: 2.1 time: 0.030466 Jan 29 03:50:55.920026 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 443/885] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:50:55 2022] DELETE /compute/v2.1/os-volumes/a71fc3a9-8c80-426f-ac76-0890db6ac652 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:50:55.933596 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1c5b3a2c-e0b0-4723-9dc4-9c5dfa1e8648 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Calling method '.version_select at 0x7f4500ba4790>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:50:55.959560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-1c5b3a2c-e0b0-4723-9dc4-9c5dfa1e8648 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] HTTP exception thrown: Volume 159f0bf6-d05e-45b8-ab7c-5ba33d9b2a1e could not be found. Jan 29 03:50:55.968105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1c5b3a2c-e0b0-4723-9dc4-9c5dfa1e8648 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] Returning 404 to user: Volume 159f0bf6-d05e-45b8-ab7c-5ba33d9b2a1e could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:50:55.968105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1c5b3a2c-e0b0-4723-9dc4-9c5dfa1e8648 tempest-VolumesNegativeTest-1278676731 tempest-VolumesNegativeTest-1278676731-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/159f0bf6-d05e-45b8-ab7c-5ba33d9b2a1e" status: 404 len: 109 microversion: 2.1 time: 0.035860 Jan 29 03:50:55.968105 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 443/886] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jan 29 03:50:55 2022] GET /compute/v2.1/os-volumes/159f0bf6-d05e-45b8-ab7c-5ba33d9b2a1e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:51:03.229301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:03.231101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:03.236469 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:03.236995 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:03.237778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:03.238245 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:03.262072 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lazy-loading 'flavor' on Instance uuid fe9bccaa-e41b-4389-9f22-5e72a04c47b0 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:51:03.566733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-82321890-f659-4743-8f4a-6ad433b6f7e6 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "POST /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0/action" status: 202 len: 0 microversion: 2.1 time: 0.342090 Jan 29 03:51:03.567228 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 444/887] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:51:03 2022] POST /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:51:03.575574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:03.576182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:03.584554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:03.585018 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:03.585805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:03.589702 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:03.723538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:03.732554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-caece5a2-1baf-49b9-861e-e552816ee462 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.160927 Jan 29 03:51:03.733241 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 444/888] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:03 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:04.752406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:04.753103 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:04.759805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:04.769578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:04.769578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:04.769578 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:04.900555 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:04.907720 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7562c59e-88c3-4ec1-b471-2a0618a5739e tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.159747 Jan 29 03:51:04.908566 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 445/889] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:04 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:05.925054 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:05.925658 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:05.931909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:05.932355 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:05.933129 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:05.933562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:06.068119 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:06.075897 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7da4f3e7-342a-427d-a20b-8ed875cf1958 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.154433 Jan 29 03:51:06.076453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 445/890] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:05 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:07.092501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:07.093101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:07.099537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:07.099978 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:07.101358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:07.101792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:07.239265 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:07.248049 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7a07de99-d3a0-4a67-aa48-8d0651d5bc54 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.159129 Jan 29 03:51:07.248623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 446/891] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:07 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:08.171847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:08.172332 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:08.178636 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:08.179087 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:08.179860 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:08.180295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:08.255017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lazy-loading 'services' on Instance uuid 852516d9-0773-4902-b732-954253533053 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:51:08.272836 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:08.273440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:08.280820 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:08.281301 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:08.282269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:08.282706 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:08.419464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:08.426700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b58adda7-2392-4580-921f-a7165e7f2c5d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.157453 Jan 29 03:51:08.427259 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:08 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:08.499791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5167b31f-6750-41fb-86a2-6e2a8dfafcc3 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053/os-volume_attachments/2ca07aab-cb3b-4492-aaed-a5b0fbdd8448" status: 202 len: 0 microversion: 2.1 time: 0.331547 Jan 29 03:51:08.500376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 446/893] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:51:08 2022] DELETE /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053/os-volume_attachments/2ca07aab-cb3b-4492-aaed-a5b0fbdd8448 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:51:09.322631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:09.323624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:09.329803 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.330296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.331065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.331495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.360266 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a855b63f-5fad-4e57-a99c-91f02255f728 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041628 Jan 29 03:51:09.360709 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 448/894] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Jan 29 03:51:09 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:09.417131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:09.417719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:09.423710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.424158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.424935 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.425387 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.443802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:09.444959 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:09.450639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.450786 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:51:09.451089 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.451861 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.452292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.601770 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:09.609079 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9417f225-26cc-488d-9fc7-4fa5bdde98ad tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.168939 Jan 29 03:51:09.612413 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 449/895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:09 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:09.815156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8dd8ac56-d359-4685-b2a9-756b0feed454 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 204 len: 0 microversion: 2.20 time: 0.402748 Jan 29 03:51:09.815765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 447/896] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Jan 29 03:51:09 2022] DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 29 03:51:09.829517 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:09.830152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:09.836351 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.836802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.837558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:09.837985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:09.968156 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:09.975798 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:09.977270 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:09.978452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8ebcc182-02bc-4b06-9a83-c5fc5828b197 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.152535 Jan 29 03:51:09.978999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 450/897] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:09 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:51:10.628397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:10.629120 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:10.634805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.635255 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.636033 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.636469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.653201 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:10.653964 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:10.660243 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.660690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.661457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.661884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.686480 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:51:10.775004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:10.783165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c8f5ee51-2b0e-49e6-8c2c-1cd32bbebc40 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.158811 Jan 29 03:51:10.783730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:10 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:10.927919 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7839ee0c-2278-4fc0-a50f-8c89b1295219 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 204 len: 0 microversion: 2.1 time: 0.278067 Jan 29 03:51:10.928422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 451/899] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:51:10 2022] DELETE /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 29 03:51:10.936195 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:10.936832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:10.942556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.943006 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.943786 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:10.944223 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:10.996143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:10.996830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:11.002882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:11.003325 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:11.004193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:11.004634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:11.079008 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:11.087422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a957a2c2-225d-44aa-bab4-9c33adacab8c tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1513 microversion: 2.1 time: 0.154542 Jan 29 03:51:11.089359 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 449/900] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:10 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:11.140015 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:11.147916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:11.149994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:11.151160 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bd857d76-e00d-4e2c-abef-eeccd51e0095 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.159100 Jan 29 03:51:11.151708 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 452/901] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:10 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:51:11.800991 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:11.801542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:11.808614 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:11.809059 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:11.809840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:11.810298 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.072010 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:12.079414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a4687892-46f1-4dd7-9a7c-5aa650751d44 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.282354 Jan 29 03:51:12.079984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 450/902] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:11 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:12.105637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:12.105637 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:12.112530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:12.113009 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.113858 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:12.114324 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.169414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:12.170022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:12.176165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:12.176799 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.177604 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:12.178805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.263084 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:12.270618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6df419b7-f731-4e5b-a912-e72ce151de23 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1513 microversion: 2.1 time: 0.169829 Jan 29 03:51:12.271179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:12 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:12.431325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:12.439067 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:12.440555 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:12.441730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d51d7017-8223-4ec5-8f68-3070a0b1ad27 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1725 microversion: 2.20 time: 0.276219 Jan 29 03:51:12.442297 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 451/904] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:12 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 29 03:51:12.882494 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-ea2bcb24-26c8-4d5d-8772-a976793baf35 req-b1e7b222-bc4f-42d4-81f1-64cdc3884ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22400b6d-3511-472c-a8d5-7ef6b31a4733", "name": "network-vif-deleted", "tag": "d74c4298-21ab-40ef-9b6c-b38299577657"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:12.884727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:51:12.884727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:51:12.891656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-ea2bcb24-26c8-4d5d-8772-a976793baf35 req-b1e7b222-bc4f-42d4-81f1-64cdc3884ac0 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:12.892344 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-ea2bcb24-26c8-4d5d-8772-a976793baf35 req-b1e7b222-bc4f-42d4-81f1-64cdc3884ac0 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:12.903296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-ea2bcb24-26c8-4d5d-8772-a976793baf35 req-b1e7b222-bc4f-42d4-81f1-64cdc3884ac0 service nova] Creating event network-vif-deleted:d74c4298-21ab-40ef-9b6c-b38299577657 for instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 on hv-cinder-82694 Jan 29 03:51:12.908171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-ea2bcb24-26c8-4d5d-8772-a976793baf35 req-b1e7b222-bc4f-42d4-81f1-64cdc3884ac0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 Jan 29 03:51:12.908780 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 454/905] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:51:13.096949 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:13.097540 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:13.112901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.112901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.112901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.112901 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.290390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:13.291369 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:13.297170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.297622 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.298442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.298879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.378928 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:13.387907 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9fb9af1c-afaa-44e1-b7d5-549ee4233bb7 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.294650 Jan 29 03:51:13.388857 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 452/906] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:13 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:13.469484 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:13.470096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:13.479114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.479574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.483407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.483905 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.488498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:13.496711 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-befcfbf4-e84d-4d51-9ef1-322a6a7bdb31 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1513 microversion: 2.1 time: 0.211924 Jan 29 03:51:13.497592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:13 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:13.540695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:13.541428 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:13.542045 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lazy-loading 'fault' on Instance uuid 22400b6d-3511-472c-a8d5-7ef6b31a4733 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:51:13.593256 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:13.601347 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:13.603457 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51fef0e311694ddcb029528bee9d5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cfcd24ac464466b0c59b2955aac89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:13.604660 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-06de9f47-43fd-4884-8f2f-9d3b2d4778bf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 200 len: 1372 microversion: 2.20 time: 0.138968 Jan 29 03:51:13.605220 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 453/908] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:13 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 29 03:51:14.406624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:14.407174 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:14.413649 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.414799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.415587 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.416024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.514846 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:14.515616 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:14.522162 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.522715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.525057 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.525674 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.559328 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:14.559499 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.559794 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.561097 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lazy-loading 'fault' on Instance uuid 852516d9-0773-4902-b732-954253533053 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:51:14.567135 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1d455fd3-5629-48ec-a189-e7aee2762afb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.164141 Jan 29 03:51:14.568270 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 456/909] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:14 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:14.608593 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4241a03c166e459d8766196eef2d8cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7211c10bef7c491bbc0bae9b8223bb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:14.612000 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4a9882e6-2409-4102-99a7-a4c946943a14 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 200 len: 1309 microversion: 2.1 time: 0.101346 Jan 29 03:51:14.612695 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 454/910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:14 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:14.628378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:14.631307 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:14.635478 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.635926 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.636697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.637126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.651226 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. Jan 29 03:51:14.651764 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:14.652572 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-781156a7-6f17-43b6-952d-eedc3899cfcf tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 404 len: 111 microversion: 2.20 time: 0.028823 Jan 29 03:51:14.653112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 457/911] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:14 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:51:14.664489 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ba64d9b6-7da0-4e9c-85b1-e055056b23c5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '.version_select at 0x7f45009d0430>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:14.718629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ba64d9b6-7da0-4e9c-85b1-e055056b23c5 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122172846" status: 204 len: 0 microversion: 2.20 time: 0.060926 Jan 29 03:51:14.719201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 455/912] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Jan 29 03:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122172846 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 29 03:51:14.927580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-bc5b8db9-6bc6-4e35-a658-1a58ac671df0 req-2a0d2aa3-6e96-486a-82a1-83d4428cce9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852516d9-0773-4902-b732-954253533053", "name": "network-vif-deleted", "tag": "68ddb4df-2cd2-4e16-b531-13f97e951b39"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:14.927580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:51:14.927580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:51:14.935795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-bc5b8db9-6bc6-4e35-a658-1a58ac671df0 req-2a0d2aa3-6e96-486a-82a1-83d4428cce9d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:14.935795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-bc5b8db9-6bc6-4e35-a658-1a58ac671df0 req-2a0d2aa3-6e96-486a-82a1-83d4428cce9d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:14.946257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-bc5b8db9-6bc6-4e35-a658-1a58ac671df0 req-2a0d2aa3-6e96-486a-82a1-83d4428cce9d service nova] Creating event network-vif-deleted:68ddb4df-2cd2-4e16-b531-13f97e951b39 for instance 852516d9-0773-4902-b732-954253533053 on hv-cinder-82694 Jan 29 03:51:14.951101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-bc5b8db9-6bc6-4e35-a658-1a58ac671df0 req-2a0d2aa3-6e96-486a-82a1-83d4428cce9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Jan 29 03:51:14.951890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 458/913] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:51:15.586970 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:15.587577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:15.593222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:15.593680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:15.594510 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:15.594947 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:15.636119 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:15.637040 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] [instance: 852516d9-0773-4902-b732-954253533053] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:15.644386 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:15.644967 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:15.646035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:15.646641 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:15.662620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] HTTP exception thrown: Instance 852516d9-0773-4902-b732-954253533053 could not be found. Jan 29 03:51:15.663220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] Returning 404 to user: Instance 852516d9-0773-4902-b732-954253533053 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:15.664802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-82837726-e86a-4b2c-9715-b13346973566 tempest-VolumesSnapshotTestJSON-279667869 tempest-VolumesSnapshotTestJSON-279667869-project] 10.222.0.16 "GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053" status: 404 len: 111 microversion: 2.1 time: 0.036963 Jan 29 03:51:15.665388 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 459/914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:15 2022] GET /compute/v2.1/servers/852516d9-0773-4902-b732-954253533053 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:51:15.756871 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:15.764980 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b6bed6fa-8f58-4b8a-99d8-ac3dcc64bf65 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.182196 Jan 29 03:51:15.766058 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 456/915] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:15 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:16.726949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:16.727422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:16.734163 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.734626 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.735484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.735928 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.752902 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. Jan 29 03:51:16.753441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:16.754310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c2a69541-ab61-485c-b913-e7a925f03868 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 404 len: 111 microversion: 2.20 time: 0.031745 Jan 29 03:51:16.755334 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 460/916] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Jan 29 03:51:16 2022] DELETE /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:51:16.764096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:16.764708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 22400b6d-3511-472c-a8d5-7ef6b31a4733] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:16.771221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.771676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.775362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.775362 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.782631 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:16.783272 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:16.787989 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. Jan 29 03:51:16.788718 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 22400b6d-3511-472c-a8d5-7ef6b31a4733 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:16.789092 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.789541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.789653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f093c34e-f90d-457a-979d-fdda9848f858 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733" status: 404 len: 111 microversion: 2.20 time: 0.029292 Jan 29 03:51:16.790115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 457/917] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:16 2022] GET /compute/v2.1/servers/22400b6d-3511-472c-a8d5-7ef6b31a4733 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 29 03:51:16.793246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:16.793717 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:16.937372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:16.940242 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-80204860-0134-4ae8-8dbd-8e5ea6e3bb69 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.161410 Jan 29 03:51:16.940800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 461/918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:16 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:17.957759 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:17.958477 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:17.965169 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:17.965626 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:17.966435 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:17.966873 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.104519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:18.111794 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-688842fd-b309-49d1-ae05-36e4d54e5efb tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1506 microversion: 2.1 time: 0.157713 Jan 29 03:51:18.112344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 458/919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:17 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:18.128213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:18.128802 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:18.135958 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.136325 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.137093 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.137519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.191326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:18.192767 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:18.200742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.201336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.202156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.202587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.348689 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6ab2bf81-db77-4c74-9ef1-e2b44110e946 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "POST /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0/action" status: 202 len: 0 microversion: 2.1 time: 0.223940 Jan 29 03:51:18.349621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 462/920] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:51:18 2022] POST /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:51:18.357313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:18.357913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:18.364381 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.364572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. Jan 29 03:51:18.364946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.365127 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:18.365993 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.366114 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-78fc9f5b-bc7f-472a-9f42-bfcd32298570 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 404 len: 111 microversion: 2.20 time: 0.178586 Jan 29 03:51:18.372102 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.372222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 459/921] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Jan 29 03:51:18 2022] DELETE /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 29 03:51:18.378730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:18.379329 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] [instance: 8f5813a3-d10f-42ef-99a5-50aa1af18f3a] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:18.385975 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.386444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.387215 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:18.387676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:18.401109 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] HTTP exception thrown: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. Jan 29 03:51:18.401823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] Returning 404 to user: Instance 8f5813a3-d10f-42ef-99a5-50aa1af18f3a could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:51:18.402682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-51656d07-4494-47c2-a735-bbcb30e14115 tempest-AttachVolumeShelveTestJSON-323054529 tempest-AttachVolumeShelveTestJSON-323054529-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a" status: 404 len: 111 microversion: 2.20 time: 0.027704 Jan 29 03:51:18.403221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 460/922] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Jan 29 03:51:18 2022] GET /compute/v2.1/servers/8f5813a3-d10f-42ef-99a5-50aa1af18f3a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 29 03:51:18.506501 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:18.515413 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8351ab3c-b195-4557-9d44-94e1475c84ff tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1514 microversion: 2.1 time: 0.161571 Jan 29 03:51:18.527247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 463/923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:18 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:51:19.534323 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:19.535393 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:19.544543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:19.545016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:19.545965 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:19.546422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:20.099751 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:20.115943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-fc3a9b86-494f-4063-a3ee-da14d205c833 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1514 microversion: 2.1 time: 0.577594 Jan 29 03:51:20.115943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 461/924] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:19 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:20.814064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-31622593-0032-4024-89f1-712b598378c4 req-718552a2-a42d-40d4-b971-c533474f8672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "name": "network-vif-unplugged", "status": "completed", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:20.818368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:51:20.818368 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:51:20.825849 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-31622593-0032-4024-89f1-712b598378c4 req-718552a2-a42d-40d4-b971-c533474f8672 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:20.826484 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-31622593-0032-4024-89f1-712b598378c4 req-718552a2-a42d-40d4-b971-c533474f8672 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:20.839547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.compute.server_external_events [req-31622593-0032-4024-89f1-712b598378c4 req-718552a2-a42d-40d4-b971-c533474f8672 service nova] Unable to find a host for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0. Dropping event network-vif-unplugged {{(pid=123253) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 29 03:51:20.840417 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-31622593-0032-4024-89f1-712b598378c4 req-718552a2-a42d-40d4-b971-c533474f8672 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033071 Jan 29 03:51:20.841483 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 464/925] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 29 03:51:21.124464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:21.125081 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:21.134805 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:21.144950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:21.144950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:21.144950 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:21.404173 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:21.411735 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d3b9218d-92e3-4634-a2d3-920304a99661 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1516 microversion: 2.1 time: 0.290836 Jan 29 03:51:21.412287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 462/926] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:21 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:22.432914 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:22.434473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:22.445496 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:22.450681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:22.459851 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:22.460373 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:22.667651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:22.675056 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c06f6dd2-b9e6-4ab7-b63c-874376783b64 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1516 microversion: 2.1 time: 0.245903 Jan 29 03:51:22.675634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 465/927] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:22 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:23.692430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:23.693368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:23.700708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:23.704187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:23.704187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:23.704187 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:23.860529 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:23.869208 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f2c25710-135c-4704-b300-6a90440902f1 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.180148 Jan 29 03:51:23.883556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 463/928] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:23 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:24.890568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:24.891178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:24.897607 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:24.898599 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:24.899364 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:24.899797 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:25.039891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:25.047482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-346e6207-5d4d-464c-b255-331a1dbfe306 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.160720 Jan 29 03:51:25.048044 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 466/929] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:24 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:26.066287 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:26.067082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:26.077128 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:26.081803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:26.081803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:26.081803 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:26.244418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:26.253043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ae4cb6f2-09b9-44d4-b11b-730fa606e714 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.192292 Jan 29 03:51:26.258486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 464/930] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:26 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:27.271611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:27.272269 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:27.279612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:27.280069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:27.280859 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:27.281300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:27.422660 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:27.429994 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c365f986-35ce-4981-999d-796b29763986 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.163839 Jan 29 03:51:27.430589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 467/931] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:27 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:28.446830 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:28.447465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:28.453582 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:28.454032 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:28.454840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:28.455276 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:28.592992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:28.600165 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2917b362-4134-4f21-b6ca-2da4380e9209 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.156986 Jan 29 03:51:28.600716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 465/932] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:28 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:29.624679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:29.625281 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:29.631826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:29.632916 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:29.633694 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:29.634120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:29.777818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:29.785215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c040df7b-87f0-4ed1-9646-5f768993925b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.164402 Jan 29 03:51:29.785771 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 468/933] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:29 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:30.802498 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:30.803108 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:30.810034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:30.810554 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:30.811339 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:30.811777 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:30.947514 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:30.954952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-52f70a50-9659-488a-9e64-443ed93bd4e3 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.156163 Jan 29 03:51:30.959533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 466/934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:30 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:31.972246 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:31.972923 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:31.979788 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:31.980231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:31.981024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:31.981482 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:32.110794 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:32.118727 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e5ce193c-d142-4fb9-ae34-f361b9e70264 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.150134 Jan 29 03:51:32.119291 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 469/935] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:31 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:33.135984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:33.136501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:33.143051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:33.144657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:33.144657 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:33.144851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:33.296840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:33.304703 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-c8f3199a-175c-4af9-a15e-9a6a0c23b357 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.172458 Jan 29 03:51:33.311353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 467/936] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:33 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:34.321806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:34.322545 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:34.329031 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:34.329476 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:34.330306 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:34.331135 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:34.468614 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:34.476492 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7818ffdf-d620-4687-97e7-4edaf1def710 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.158237 Jan 29 03:51:34.477062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 470/937] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:34 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:35.492802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:35.493410 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:35.499919 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:35.500855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:35.501130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:35.501564 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:35.642887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:35.650110 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-3aa5ad04-5dba-4aa5-a05c-de900a324aa4 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.161399 Jan 29 03:51:35.650692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 468/938] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:35 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:36.666664 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:36.667263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:36.673618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:36.674063 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:36.674903 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:36.675345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:36.813862 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:36.821970 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-bc1f2839-53d5-41a8-9708-8a4ad1a7be7b tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.158888 Jan 29 03:51:36.822583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 471/939] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:36 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:37.171310 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-820ebc55-b1cd-483e-bbca-d45b3ed06abb req-9e6bcbfe-58c5-43fd-aa53-b81a7db674be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "name": "network-vif-plugged", "status": "completed", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:51:37.172851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:51:37.172851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:51:37.180893 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-820ebc55-b1cd-483e-bbca-d45b3ed06abb req-9e6bcbfe-58c5-43fd-aa53-b81a7db674be service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:37.181338 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-820ebc55-b1cd-483e-bbca-d45b3ed06abb req-9e6bcbfe-58c5-43fd-aa53-b81a7db674be service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:37.193186 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-820ebc55-b1cd-483e-bbca-d45b3ed06abb req-9e6bcbfe-58c5-43fd-aa53-b81a7db674be service nova] Creating event network-vif-plugged:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:51:37.200395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-820ebc55-b1cd-483e-bbca-d45b3ed06abb req-9e6bcbfe-58c5-43fd-aa53-b81a7db674be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Jan 29 03:51:37.200874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 469/940] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:51:37.840996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:37.841513 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:37.847863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:37.855226 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:37.855226 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:37.855226 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:37.990530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:37.997792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-56d3418d-0ea8-43c9-b71d-6a13cfc4a800 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1572 microversion: 2.1 time: 0.160501 Jan 29 03:51:37.998384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 472/941] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:37 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:39.018638 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:51:39.019378 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:51:39.025609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:39.026064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:39.026952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:51:39.027394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:51:39.160788 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:51:39.168923 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-08f774ef-1a92-428a-987b-ca70736f3528 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1559 microversion: 2.1 time: 0.157503 Jan 29 03:51:39.170043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 470/942] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:51:39 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:51:43.889340 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:51:43.889895 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 03:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:52:08.047356 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'create', calling method: .version_select at 0x7f45016c4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-527034634"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:08.061573 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:52:08.065308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for user 7959d926ec9643588eddde7d1d41cefd and project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:52:08.303944 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:52:08.307547 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for user 7959d926ec9643588eddde7d1d41cefd and project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'key_pairs'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:52:08.319779 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-469d96c7-af46-4713-9876-ffb0d7d23b95 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.276224 Jan 29 03:52:08.320350 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 473/943] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Jan 29 03:52:08 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:08.367692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-846756026", "imageRef": "20e5a94e-66c1-4782-902a-c309fff86994", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-527034634", "networks": [{"uuid": "798a8598-5f86-4e39-b13a-1feeb15fd786"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:08.415295 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] validate_networks() for [('798a8598-5f86-4e39-b13a-1feeb15fd786', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:52:08.781446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:52:08.781867 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:52:08.782373 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:52:08.782783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:52:08.783217 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:52:08.791861 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:08.792334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:08.793141 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:08.793569 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:08.809523 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:52:08.813330 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Getting quotas for user 7959d926ec9643588eddde7d1d41cefd and project 99ad53cf12564d5ea40131bca81e8f3b. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:52:08.824274 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:52:08.826444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20e5a94e-66c1-4782-902a-c309fff86994',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:52:08.945538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8c62bfaf-e725-4c12-94cc-64a515ae0efb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581547 Jan 29 03:52:08.951651 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 471/944] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:52:08.956380 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-76e0cb6e-181b-4bf1-abbc-19138f7301d8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:08.956982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-76e0cb6e-181b-4bf1-abbc-19138f7301d8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:09.011227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-76e0cb6e-181b-4bf1-abbc-19138f7301d8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:09.018399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-76e0cb6e-181b-4bf1-abbc-19138f7301d8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1257 microversion: 2.1 time: 0.065506 Jan 29 03:52:09.019795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 474/945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:08 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:10.036524 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:10.037140 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:10.043790 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:10.044243 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:10.045012 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:10.045447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:10.102659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:10.110333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-336f84b1-42b6-4ec5-af41-10fe648ba933 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1261 microversion: 2.1 time: 0.077545 Jan 29 03:52:10.110887 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 472/946] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:10 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:11.126302 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:11.126903 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:11.132670 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:11.133108 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:11.133863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:11.134347 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:11.194457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:11.201498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a852f5ec-96be-4eaf-8267-32d6df132aa7 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1261 microversion: 2.1 time: 0.079018 Jan 29 03:52:11.202073 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 475/947] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:11 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:12.217812 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:12.219016 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:12.225726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:12.226216 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:12.231025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:12.231025 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:12.288527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:12.295844 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-60e17391-417b-44b2-b472-469bd8c861ec tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1261 microversion: 2.1 time: 0.081684 Jan 29 03:52:12.296397 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 473/948] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:12 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:13.313855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:13.314557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:13.322038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:13.322560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:13.323289 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:13.323710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:13.386464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:13.394011 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-16797601-3d67-485f-8c08-909fd5731c45 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1317 microversion: 2.1 time: 0.084585 Jan 29 03:52:13.394669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 476/949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:13 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:14.417547 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:14.420745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:14.430167 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:14.430948 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:14.431942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:14.432769 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:14.819717 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:14.829864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dbcfb3b1-439a-4fa6-901a-8378ac891489 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.421774 Jan 29 03:52:14.830475 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 474/950] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:14 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:15.468022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-d9bb40e9-7483-4d94-9c7f-dcbe7a162250 req-ecc5c1e1-69c6-4c87-9548-6e847b780d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:15.474384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:15.474384 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:52:15.484137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d9bb40e9-7483-4d94-9c7f-dcbe7a162250 req-ecc5c1e1-69c6-4c87-9548-6e847b780d50 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:15.484808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-d9bb40e9-7483-4d94-9c7f-dcbe7a162250 req-ecc5c1e1-69c6-4c87-9548-6e847b780d50 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:15.504708 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-d9bb40e9-7483-4d94-9c7f-dcbe7a162250 req-ecc5c1e1-69c6-4c87-9548-6e847b780d50 service nova] Creating event network-changed:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:52:15.510399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-d9bb40e9-7483-4d94-9c7f-dcbe7a162250 req-ecc5c1e1-69c6-4c87-9548-6e847b780d50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049794 Jan 29 03:52:15.515510 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 477/951] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:52:15.848497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:15.849691 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:15.857197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:15.857692 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:15.858501 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:15.859235 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:16.021728 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:16.033115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-55f003ef-5d0a-4853-bba5-2dc10ea1a0fc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.188483 Jan 29 03:52:16.033814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 475/952] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:15 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:17.051879 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:17.052798 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:17.058974 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:17.059423 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:17.060221 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:17.060658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:17.268932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:17.276678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4477a3ec-6717-4341-b216-aa8bc9fe1294 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.229459 Jan 29 03:52:17.287278 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 478/953] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:17 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:18.295904 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:18.297783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:18.305618 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:18.306367 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:18.307495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:18.308177 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:18.496646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:18.506724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5d7a64a2-48f7-4c12-a4d6-9b4bbfae1506 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.216633 Jan 29 03:52:18.507533 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 476/954] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:18 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:19.524152 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:19.524955 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:19.531612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:19.532065 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:19.532887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:19.533326 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:19.733287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:19.733287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2d7a37cf-ab62-4f75-ae72-76fe80fb6c1c tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.167138 Jan 29 03:52:19.733287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 479/955] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:19 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:20.722672 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:20.726418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:20.741069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:20.741797 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:20.742809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:20.743400 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:20.891676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:20.900847 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a1a1c8f9-8468-4618-9e43-c1c09b800688 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.183295 Jan 29 03:52:20.911214 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 477/956] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:20 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:21.918553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:21.919188 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:21.925584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:21.926027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:21.926828 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:21.927261 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:22.081187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:22.091969 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6048ee17-f1c0-46c2-a5f4-4acb51a75bc6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.177738 Jan 29 03:52:22.092877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 480/957] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:21 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:23.109543 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:23.110223 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:23.123608 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:23.124064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:23.124881 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:23.125320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:23.262202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:23.270254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-521d9165-1f45-4dd9-a0aa-1179ed9aefc8 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.164472 Jan 29 03:52:23.270816 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 478/958] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:23 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:24.288024 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:24.288652 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:24.294913 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:24.295355 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:24.296126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:24.296553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:24.428310 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:24.436087 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9b3c5f13-6879-486c-911e-ee005446c3f2 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.151695 Jan 29 03:52:24.436657 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 481/959] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:24 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:25.452645 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:25.453254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:25.459455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:25.459903 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:25.460671 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:25.461102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:25.597228 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:25.604366 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e11ddfbc-4e77-4197-81af-ea0386d48f53 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.155374 Jan 29 03:52:25.604913 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:25 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:26.620848 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:26.621459 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:26.627654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:26.628108 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:26.634244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:26.634244 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:26.764219 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:26.771856 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8f124536-0ebc-4ac7-80d3-79fc6ffd6c62 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.154709 Jan 29 03:52:26.772560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 482/961] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:26 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:27.468537 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-05a2c643-b8cf-4318-9f76-7bc59a16df0c req-3531792f-2008-4f61-89a9-bc1e44ffd957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "name": "network-vif-plugged", "status": "completed", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:27.470199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:27.470199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:52:27.478944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-05a2c643-b8cf-4318-9f76-7bc59a16df0c req-3531792f-2008-4f61-89a9-bc1e44ffd957 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:27.479334 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-05a2c643-b8cf-4318-9f76-7bc59a16df0c req-3531792f-2008-4f61-89a9-bc1e44ffd957 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:27.489892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-05a2c643-b8cf-4318-9f76-7bc59a16df0c req-3531792f-2008-4f61-89a9-bc1e44ffd957 service nova] Creating event network-vif-plugged:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:52:27.495467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-05a2c643-b8cf-4318-9f76-7bc59a16df0c req-3531792f-2008-4f61-89a9-bc1e44ffd957 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Jan 29 03:52:27.496070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 480/962] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:52:27.788778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:27.789375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:27.797402 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:27.797939 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:27.799893 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:27.800323 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:27.937037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:27.944193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8fa1db16-f97c-4315-9685-d52038941a5b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.159314 Jan 29 03:52:27.944975 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 483/963] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:27 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:28.961464 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:28.962210 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:28.968113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:28.968562 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:28.969369 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:28.969801 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:29.115183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:29.123536 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2ac23309-8a2b-479b-8d99-bd0480df644b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1357 microversion: 2.1 time: 0.166461 Jan 29 03:52:29.125254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 481/964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:28 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:30.140719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:30.141596 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:30.148145 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.148795 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.150295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.150891 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.293239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:30.300781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-120abc0a-596e-4ed7-9742-bdc3ac20cc37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1547 microversion: 2.1 time: 0.164263 Jan 29 03:52:30.301592 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 484/965] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:30 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:30.316649 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:30.318220 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:30.323640 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.324094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.324884 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.325325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.458668 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:30.472951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8d63ba79-b367-45fe-854f-709437dd5677 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1547 microversion: 2.1 time: 0.153420 Jan 29 03:52:30.472951 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:30 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:30.486327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:30.489719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:30.489719 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:52:30.490728 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:30.491464 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Searching by: {'deleted': False, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b'} {{(pid=123253) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 29 03:52:30.501733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.501733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.501733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.501733 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.593035 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.multi_cell_list [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123253) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 29 03:52:30.840350 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-04b090d1-9049-49d6-baaa-ef17dc11abfb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.357730 Jan 29 03:52:30.840927 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 485/967] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Jan 29 03:52:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:52:30.850992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:30.851605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:30.857275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.857726 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.863197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:30.863197 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:30.989708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:30.997708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5cff5b40-9636-4892-8e19-40365dd1033a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1547 microversion: 2.1 time: 0.150234 Jan 29 03:52:30.998306 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 483/968] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:30 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:32.824775 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be101ddf-de9b-42fc-8c63-422dab350e56"}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:32.825852 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:32.832202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:32.832688 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:32.833462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:32.833894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:33.641522 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f8434d26-e91f-4754-bf69-27d441854d31 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820016 Jan 29 03:52:33.642146 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 486/969] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Jan 29 03:52:32 2022] POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:52:41.163463 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:41.164262 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:41.171225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:41.171680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:41.172799 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:41.172925 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:41.315309 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:41.323023 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d9463b2d-572b-4184-89e1-b10a894a3d10 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1593 microversion: 2.1 time: 0.164361 Jan 29 03:52:41.323577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 484/970] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:41 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:52:43.902951 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-578fbd11-3b8b-48cb-adc1-b83c4d3ba986 req-533b5653-20c2-4569-82d2-d2cef398f020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:43.905374 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:43.905374 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:52:43.913520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-578fbd11-3b8b-48cb-adc1-b83c4d3ba986 req-533b5653-20c2-4569-82d2-d2cef398f020 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:43.914416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-578fbd11-3b8b-48cb-adc1-b83c4d3ba986 req-533b5653-20c2-4569-82d2-d2cef398f020 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:43.926498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-578fbd11-3b8b-48cb-adc1-b83c4d3ba986 req-533b5653-20c2-4569-82d2-d2cef398f020 service nova] Creating event network-changed:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:52:43.931491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-578fbd11-3b8b-48cb-adc1-b83c4d3ba986 req-533b5653-20c2-4569-82d2-d2cef398f020 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Jan 29 03:52:43.932077 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 487/971] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:52:46.632407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1823772074"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:46.632981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:46.639528 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:46.639979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:46.640756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:46.641439 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:46.774661 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.network.security_group_api [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Adding security group b33f1097-0e3c-427f-889d-998e3d017b3e to port 5693b10e-5880-4367-8e86-dc545a331b14 Jan 29 03:52:47.233372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0c9c63e8-38e6-4c66-9515-f1adaea10295 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action" status: 202 len: 0 microversion: 2.1 time: 0.600320 Jan 29 03:52:47.235634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 485/972] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:52:46 2022] POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:52:47.241611 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a7675d92-a558-4035-89ef-aa764515ee03 req-7757aba5-680a-456b-98e3-08c12895fd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:47.243922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:47.243922 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:52:47.245583 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:47.247451 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:47.265063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:47.265063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:47.265063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:47.265063 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:47.265479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a7675d92-a558-4035-89ef-aa764515ee03 req-7757aba5-680a-456b-98e3-08c12895fd03 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:47.265479 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a7675d92-a558-4035-89ef-aa764515ee03 req-7757aba5-680a-456b-98e3-08c12895fd03 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:47.282053 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a7675d92-a558-4035-89ef-aa764515ee03 req-7757aba5-680a-456b-98e3-08c12895fd03 service nova] Creating event network-changed:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:52:47.291830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a7675d92-a558-4035-89ef-aa764515ee03 req-7757aba5-680a-456b-98e3-08c12895fd03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058016 Jan 29 03:52:47.293315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 488/973] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:52:47.545926 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:52:47.558833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4730969c-651f-49ab-be08-b2a44cb3132a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1759 microversion: 2.1 time: 0.317716 Jan 29 03:52:47.558833 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 486/974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:52:47 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1759 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:52:59.868263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-44423900-6224-4b70-86db-c16721074eea req-f9b9e0f0-e1da-4f34-b95c-711b390c3be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:52:59.869247 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:52:59.870004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:52:59.870004 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:52:59.870512 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:52:59.877991 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-44423900-6224-4b70-86db-c16721074eea req-f9b9e0f0-e1da-4f34-b95c-711b390c3be7 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:59.878257 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:59.878458 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-44423900-6224-4b70-86db-c16721074eea req-f9b9e0f0-e1da-4f34-b95c-711b390c3be7 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:59.878890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:59.879814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:52:59.880460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:52:59.890559 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-44423900-6224-4b70-86db-c16721074eea req-f9b9e0f0-e1da-4f34-b95c-711b390c3be7 service nova] Creating event network-changed:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:52:59.896092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-44423900-6224-4b70-86db-c16721074eea req-f9b9e0f0-e1da-4f34-b95c-711b390c3be7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031328 Jan 29 03:52:59.897095 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 487/975] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:52:59.906921 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:53:00.166450 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-369ba98d-c047-465b-8ac2-e0b97ad4eb06 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 204 len: 0 microversion: 2.1 time: 0.302757 Jan 29 03:53:00.167231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 489/976] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:52:59 2022] DELETE /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:53:00.176377 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:00.177076 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:00.183681 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:00.184467 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:00.185446 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:00.185885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:00.411717 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:00.419622 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-57727bf3-8e89-4b3b-af90-bdbc2a8d3a53 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1565 microversion: 2.1 time: 0.248087 Jan 29 03:53:00.420434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 488/977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:00 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1565 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:53:01.438452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:01.439183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:01.445387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.445838 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:01.446645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.447124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:01.589700 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:01.597785 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-07da324d-602a-41f7-83cf-b3c5f2267107 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1446 microversion: 2.1 time: 0.163311 Jan 29 03:53:01.598379 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 490/978] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:01 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:01.696883 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:53:01.697899 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:01.704843 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.705299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:01.712653 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.713115 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:01.940538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0b27b826-c00c-42b9-a39a-bc40bb1e2983 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action" status: 202 len: 0 microversion: 2.1 time: 0.247378 Jan 29 03:53:01.941081 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 489/979] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:53:01 2022] POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:53:01.948905 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:01.949532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:01.955860 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.960025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:01.960025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:01.960025 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:02.145897 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:02.153813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d9845162-a915-48d1-b8d4-f8fa263cd53f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1751 microversion: 2.1 time: 0.208529 Jan 29 03:53:02.154419 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 491/980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:01 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:02.615495 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:02.616441 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:02.622353 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:02.622801 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:02.623580 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:02.624040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:02.941831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:02.949361 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ce5ff23a-eefc-420b-ad84-b5c00842f1ca tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1446 microversion: 2.1 time: 0.338161 Jan 29 03:53:02.959285 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 490/981] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:02 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1446 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:03.165008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-35562d65-628b-44a1-98d7-c64e5dc1a6c7 req-48b934f9-4fcb-47d6-9186-628ec8177b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9bccaa-e41b-4389-9f22-5e72a04c47b0", "name": "network-vif-deleted", "tag": "275c2605-c149-4f30-83c0-37611406ba82"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:53:03.168945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:53:03.168945 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:53:03.170796 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:03.171509 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:03.177809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:03.177970 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-35562d65-628b-44a1-98d7-c64e5dc1a6c7 req-48b934f9-4fcb-47d6-9186-628ec8177b8a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:03.178372 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-35562d65-628b-44a1-98d7-c64e5dc1a6c7 req-48b934f9-4fcb-47d6-9186-628ec8177b8a service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:03.179780 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:03.180686 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:03.181344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:03.192366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-35562d65-628b-44a1-98d7-c64e5dc1a6c7 req-48b934f9-4fcb-47d6-9186-628ec8177b8a service nova] Creating event network-vif-deleted:275c2605-c149-4f30-83c0-37611406ba82 for instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 on hv-cinder-82694 Jan 29 03:53:03.198192 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-35562d65-628b-44a1-98d7-c64e5dc1a6c7 req-48b934f9-4fcb-47d6-9186-628ec8177b8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039992 Jan 29 03:53:03.198796 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 492/982] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:53:03.365388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:03.373161 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-be0449fd-e0bd-4aab-957e-371f4dfb975b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1751 microversion: 2.1 time: 0.206074 Jan 29 03:53:03.383944 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 491/983] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:03 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:53:03.966435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:03.967124 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:03.973062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:03.973506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:03.974361 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:03.974786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:04.039633 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feda89ffc1894415bf64f0b8b303cd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033b0334af9941dfbcf5ac732f36dfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:04.047053 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-a0cea892-b0e9-4d2e-b413-b39140bb86d8 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 200 len: 1216 microversion: 2.1 time: 0.084682 Jan 29 03:53:04.047621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 493/984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:03 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:04.389724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:04.390379 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:04.397017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:04.397469 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:04.398272 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:04.398711 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:04.554934 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:04.562676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2ab180e9-0d09-49a1-8279-fd0c4b728a37 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.176711 Jan 29 03:53:04.563230 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 492/985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:04 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:05.064461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:05.065231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] [instance: fe9bccaa-e41b-4389-9f22-5e72a04c47b0] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:05.071653 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:05.072095 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:05.072869 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:05.073296 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:05.086998 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] HTTP exception thrown: Instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 could not be found. Jan 29 03:53:05.087584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Returning 404 to user: Instance fe9bccaa-e41b-4389-9f22-5e72a04c47b0 could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:53:05.088389 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4c0d65b9-198c-4131-a691-414ce461031d tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0" status: 404 len: 111 microversion: 2.1 time: 0.028073 Jan 29 03:53:05.088920 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 494/986] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:05 2022] GET /compute/v2.1/servers/fe9bccaa-e41b-4389-9f22-5e72a04c47b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:53:05.344077 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-2cf768a7-fca0-4498-9f23-a44bb64b0141 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] Calling method '.version_select at 0x7f45009dfa60>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:05.449737 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-2cf768a7-fca0-4498-9f23-a44bb64b0141 tempest-TestShelveInstance-1603665791 tempest-TestShelveInstance-1603665791-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-86261245" status: 202 len: 0 microversion: 2.1 time: 0.109211 Jan 29 03:53:05.453035 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 493/987] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jan 29 03:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-86261245 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:53:05.581234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:05.582116 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:05.589193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:05.590111 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:05.591222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:05.591871 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:05.749046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:05.757045 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4cfd15b1-0ba3-4df0-b41a-28da8c954387 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.180902 Jan 29 03:53:05.757601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 495/988] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:05 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:06.775382 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:06.775988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:06.782725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:06.783275 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:06.784075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:06.784552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:07.035861 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:07.044202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dbcdce6b-ec3f-4600-a50e-8dae1fc6de9e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.273032 Jan 29 03:53:07.054182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 494/989] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:06 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:08.061581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:08.062532 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:08.069521 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:08.070179 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:08.071144 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:08.071583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:08.288126 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:08.295978 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-8f8677d9-f83d-4f8f-947f-5ff169d6e986 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.238101 Jan 29 03:53:08.296535 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 496/990] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:08 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:09.312820 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:09.314237 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:09.320729 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:09.321298 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:09.322213 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:09.322751 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:09.483738 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:09.492368 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4d8b2b1e-86f8-44fc-8749-ff85a7acd524 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.183317 Jan 29 03:53:09.492927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 495/991] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:09 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:10.509865 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:10.510489 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:10.517533 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:10.517968 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:10.518762 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:10.519187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:10.670230 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:10.683618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-486cea90-58d4-450b-a775-2ec1f388bdbc tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.177037 Jan 29 03:53:10.684533 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 497/992] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:10 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:11.700942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:11.701589 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:11.708308 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:11.709113 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:11.709937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:11.710414 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:11.932092 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:11.940097 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-324b131d-fa7c-41ff-b41e-b699dd06f661 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.243054 Jan 29 03:53:11.940824 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 496/993] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:11 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:12.956782 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:12.957408 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:12.963786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:12.964240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:12.965027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:12.965462 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:13.116380 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:13.124353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fff064ca-0dc8-4002-94b7-8edff3d6c70d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.171291 Jan 29 03:53:13.125186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 498/994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:12 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:14.142178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:14.142964 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:14.149303 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:14.149756 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:14.150579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:14.151022 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:14.298205 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:14.305864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-dd6c253f-4b8a-43b8-bb33-aaa4edadaedd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1756 microversion: 2.1 time: 0.167680 Jan 29 03:53:14.306447 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 497/995] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:14 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:15.322623 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:15.323225 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:15.329495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:15.329965 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:15.341591 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:15.341591 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:15.493943 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:15.503353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-333d7822-dcb9-47ad-93e3-e71d41c9a511 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1759 microversion: 2.1 time: 0.184333 Jan 29 03:53:15.504159 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 499/996] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:15 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:48.003870 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1823772074"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:53:48.004486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:48.010284 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:48.014203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:48.014203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:48.014203 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:48.155574 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.network.security_group_api [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Removing security group b33f1097-0e3c-427f-889d-998e3d017b3e from port 5693b10e-5880-4367-8e86-dc545a331b14 Jan 29 03:53:48.570781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-380def85-6034-46cb-80a3-ba0f4e523439 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action" status: 202 len: 0 microversion: 2.1 time: 0.570071 Jan 29 03:53:48.579579 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 498/997] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Jan 29 03:53:47 2022] POST /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:53:48.585387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-a9f24b79-c234-4e78-b585-fb0bea870e33 req-0e236275-f632-4247-9cb3-ec3af6d1b664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:53:48.588885 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:53:48.588885 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:53:48.599452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a9f24b79-c234-4e78-b585-fb0bea870e33 req-0e236275-f632-4247-9cb3-ec3af6d1b664 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:48.600294 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-a9f24b79-c234-4e78-b585-fb0bea870e33 req-0e236275-f632-4247-9cb3-ec3af6d1b664 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:48.618739 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-a9f24b79-c234-4e78-b585-fb0bea870e33 req-0e236275-f632-4247-9cb3-ec3af6d1b664 service nova] Creating event network-changed:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:53:48.631850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-a9f24b79-c234-4e78-b585-fb0bea870e33 req-0e236275-f632-4247-9cb3-ec3af6d1b664 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051913 Jan 29 03:53:48.632641 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 500/998] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:53:50.259988 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:50.261125 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:50.268344 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:50.268739 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:50.269520 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:50.270637 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:50.379710 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.objects.instance [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lazy-loading 'services' on Instance uuid 1eb9c795-02a0-4502-a49f-032ef0fdfae1 {{(pid=123254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:53:50.389654 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-5642b678-150f-43cc-8dc5-8d57c892c79a req-40318d0f-fabb-45ef-91e1-71e8327b1e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:53:50.391815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:53:50.391815 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:53:50.399584 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-5642b678-150f-43cc-8dc5-8d57c892c79a req-40318d0f-fabb-45ef-91e1-71e8327b1e65 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:50.400029 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-5642b678-150f-43cc-8dc5-8d57c892c79a req-40318d0f-fabb-45ef-91e1-71e8327b1e65 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:50.412273 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-5642b678-150f-43cc-8dc5-8d57c892c79a req-40318d0f-fabb-45ef-91e1-71e8327b1e65 service nova] Creating event network-changed:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:53:50.417846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-5642b678-150f-43cc-8dc5-8d57c892c79a req-40318d0f-fabb-45ef-91e1-71e8327b1e65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159474 Jan 29 03:53:50.418461 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 501/999] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:53:50.593809 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-26cd4904-ad5b-49a6-bf60-d2e734ae308e tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments/be101ddf-de9b-42fc-8c63-422dab350e56" status: 202 len: 0 microversion: 2.1 time: 0.338172 Jan 29 03:53:50.594430 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 499/1000] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:53:50 2022] DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments/be101ddf-de9b-42fc-8c63-422dab350e56 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:53:50.605646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:50.606598 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:50.613490 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:50.613960 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:50.614747 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:50.615239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:50.652949 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-7dddd433-8a3f-43d1-a2ad-4a02aa967c6b tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052943 Jan 29 03:53:50.657855 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 502/1001] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:53:50 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:53:51.665453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:51.666673 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:51.673773 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:51.674278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:51.675096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:51.675745 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:51.705009 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7aa83aba-9b19-4e09-b78b-fc9df0add2b6 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Jan 29 03:53:51.705825 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 500/1002] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:53:51 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:53:52.732526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:52.732526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:52.732526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:52.732526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:52.733445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:52.733445 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:52.753734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e91fd15b-1a30-4591-8fa0-1a9bb99bed74 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041032 Jan 29 03:53:52.754311 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 503/1003] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jan 29 03:53:52 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 29 03:53:52.764442 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:52.765223 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:52.771519 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:52.771969 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:52.772740 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:52.773175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:52.852130 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] HTTP exception thrown: Instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 is not attached to volume be101ddf-de9b-42fc-8c63-422dab350e56 Jan 29 03:53:52.852734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Returning 404 to user: Instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 is not attached to volume be101ddf-de9b-42fc-8c63-422dab350e56 {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:53:52.853578 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5c754499-2eae-41d9-b3a1-f719e65d63eb tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments/be101ddf-de9b-42fc-8c63-422dab350e56" status: 404 len: 154 microversion: 2.1 time: 0.093460 Jan 29 03:53:52.854161 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 501/1004] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Jan 29 03:53:52 2022] DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1/os-volume_attachments/be101ddf-de9b-42fc-8c63-422dab350e56 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:53:54.188710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:54.189202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:54.195320 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:54.195769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:54.196530 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:54.196956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:54.219721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:53:54.539351 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b3fdfc53-e555-45c1-a0ec-fafe918668fd tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 204 len: 0 microversion: 2.1 time: 0.353896 Jan 29 03:53:54.539941 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 504/1005] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:53:54 2022] DELETE /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 03:53:54.548545 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:54.549278 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:54.555518 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:54.555966 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:54.556730 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:54.557159 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:54.690096 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:54.697394 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-f47db9bc-e38d-4908-ba9b-ea0aaedc524d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1553 microversion: 2.1 time: 0.152631 Jan 29 03:53:54.697945 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 502/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:54 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:55.716062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:55.716756 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:55.722954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:55.723398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:55.724170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:55.724602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:55.854602 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:55.861947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1935bd8f-1983-465c-9d14-8b8cb3e39d5f tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1553 microversion: 2.1 time: 0.150506 Jan 29 03:53:55.862544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 505/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:55 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:56.879659 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:56.880345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:56.886682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:56.887137 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:56.887914 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:56.888352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:57.018623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:57.025832 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-44b5889c-a19b-4b97-be0e-b189539d9fa0 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1553 microversion: 2.1 time: 0.149822 Jan 29 03:53:57.031120 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 503/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:56 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:58.043406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:58.044008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:58.050235 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:58.050678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:58.051435 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:58.051864 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:58.186932 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:58.193999 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fc4ec86b-28dd-4811-997d-3df0f234ebc3 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1553 microversion: 2.1 time: 0.154302 Jan 29 03:53:58.194658 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 506/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:58 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:53:59.211564 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:53:59.212178 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:53:59.219199 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:59.219654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:59.220440 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:53:59.220884 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:53:59.351513 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:53:59.358783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-159c0919-c4f0-4144-8492-ce404f6af3ff tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1553 microversion: 2.1 time: 0.150972 Jan 29 03:53:59.359341 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 504/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:53:59 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:00.023564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-3a91e08a-e039-4512-bd0b-2f01d7028057 req-9a25a844-060f-4db2-8c8b-29c35123ba3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb9c795-02a0-4502-a49f-032ef0fdfae1", "name": "network-vif-deleted", "tag": "5693b10e-5880-4367-8e86-dc545a331b14"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:54:00.025369 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:54:00.025369 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:54:00.032673 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3a91e08a-e039-4512-bd0b-2f01d7028057 req-9a25a844-060f-4db2-8c8b-29c35123ba3c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:00.033109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-3a91e08a-e039-4512-bd0b-2f01d7028057 req-9a25a844-060f-4db2-8c8b-29c35123ba3c service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:00.044249 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-3a91e08a-e039-4512-bd0b-2f01d7028057 req-9a25a844-060f-4db2-8c8b-29c35123ba3c service nova] Creating event network-vif-deleted:5693b10e-5880-4367-8e86-dc545a331b14 for instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 on hv-cinder-82694 Jan 29 03:54:00.049239 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-3a91e08a-e039-4512-bd0b-2f01d7028057 req-9a25a844-060f-4db2-8c8b-29c35123ba3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 Jan 29 03:54:00.050557 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 507/1011] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:54:00.375802 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:00.376609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:00.383075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:00.383531 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:00.384324 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:00.384769 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:00.449259 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:00.456648 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-db58a272-6ff4-4fd8-bfec-9b50d2fa072d tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1511 microversion: 2.1 time: 0.084610 Jan 29 03:54:00.457206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 505/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:00 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:01.475452 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:01.476143 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:01.483040 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:01.483422 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:01.484193 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:01.484813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:01.515240 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:01.515683 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:01.516123 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lazy-loading 'fault' on Instance uuid 1eb9c795-02a0-4502-a49f-032ef0fdfae1 {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:54:01.555620 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7959d926ec9643588eddde7d1d41cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ad53cf12564d5ea40131bca81e8f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:01.563415 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-f09ffc1d-4c12-4043-ad10-b30f3e61e40a tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 200 len: 1347 microversion: 2.1 time: 0.093161 Jan 29 03:54:01.563966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:01 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:02.580232 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:02.580855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] [instance: 1eb9c795-02a0-4502-a49f-032ef0fdfae1] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:02.587110 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:02.587568 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:02.588352 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:02.588791 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:02.601752 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] HTTP exception thrown: Instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 could not be found. Jan 29 03:54:02.602372 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Returning 404 to user: Instance 1eb9c795-02a0-4502-a49f-032ef0fdfae1 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:54:02.603206 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-d369c1a1-7824-4684-a8a7-809b62be84f1 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1" status: 404 len: 111 microversion: 2.1 time: 0.026673 Jan 29 03:54:02.603719 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 506/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:02 2022] GET /compute/v2.1/servers/1eb9c795-02a0-4502-a49f-032ef0fdfae1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:54:02.611760 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1e4d710c-d00a-4398-8749-3cf99ee88dc4 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] Calling method '.version_select at 0x7f45009d0af0>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:02.751543 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1e4d710c-d00a-4398-8749-3cf99ee88dc4 tempest-TestMinimumBasicScenario-414022836 tempest-TestMinimumBasicScenario-414022836-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-527034634" status: 202 len: 0 microversion: 2.1 time: 0.143453 Jan 29 03:54:02.752116 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 509/1015] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Jan 29 03:54:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-527034634 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 03:54:19.462042 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:54:19.462697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 03:54:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:54:21.452954 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:54:21.453491 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 03:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:54:25.595552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Action: 'create', calling method: .version_select at 0x7f4500a0a550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-924064062"}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:54:25.609714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:54:25.613558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for user 0639cda3fd4e406290324e3c61529bd6 and project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:54:25.949070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:54:25.953090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for user 0639cda3fd4e406290324e3c61529bd6 and project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'key_pairs'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:54:25.967384 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7033c5d5-2d21-4e49-9f6c-87d01fc00df7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.534810 Jan 29 03:54:25.968223 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 507/1016] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Jan 29 03:54:25 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:44.032662 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1304969148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-924064062", "security_groups": [{"name": "tempest-secgroup-smoke-1196771207"}], "block_device_mapping_v2": [{"uuid": "8247dc62-0b18-416a-be28-7b9c7a919ebc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccb34270-5897-4f8c-bf79-a40c6714fbbe"}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:54:44.237989 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] validate_networks() for [('ccb34270-5897-4f8c-bf79-a40c6714fbbe', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:54:44.632544 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:54:44.632966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:54:44.633473 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:54:44.633946 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:54:44.634398 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:54:44.643846 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:44.644295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:44.645103 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:44.645537 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:44.661263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:54:44.665070 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for user 0639cda3fd4e406290324e3c61529bd6 and project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:54:44.717636 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:54:44.725282 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8247dc62-0b18-416a-be28-7b9c7a919ebc',volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:54:45.169042 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cd5b4359-bc45-4a56-b5d2-2eda1e2f73e4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.141140 Jan 29 03:54:45.170064 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 510/1017] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:54:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:54:45.180656 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-527e28f5-86a4-4a1f-928e-7aa06bc21501 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:45.181272 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-527e28f5-86a4-4a1f-928e-7aa06bc21501 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:45.339245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-527e28f5-86a4-4a1f-928e-7aa06bc21501 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:45.346315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-527e28f5-86a4-4a1f-928e-7aa06bc21501 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1094 microversion: 2.1 time: 0.169821 Jan 29 03:54:45.346877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 508/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:45 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1094 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:46.364067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:46.364702 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:46.370734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:46.371183 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:46.371951 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:46.372383 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:46.431887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:46.439826 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-2f2ca331-6a16-4e45-ba71-e84cf03b60d6 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1144 microversion: 2.1 time: 0.080455 Jan 29 03:54:46.440387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 511/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:46 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:47.457423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:47.458186 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:47.465249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:47.466376 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:47.467094 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:47.467527 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:47.533486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:47.540676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0593dc59-bcd9-43c0-9cee-508105ae2231 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1210 microversion: 2.1 time: 0.087710 Jan 29 03:54:47.541218 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 509/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:47 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:48.557562 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:48.558168 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:48.564834 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:48.565282 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:48.566067 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:48.566526 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:48.717120 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:48.725583 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-35742474-d5ee-4b1c-a49a-bf231e1858c2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1278 microversion: 2.1 time: 0.171758 Jan 29 03:54:48.726184 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 512/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:48 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:49.300733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-81b73cc5-e4c4-47d1-b9be-805a9f64d461 req-b965e301-3d5d-4f85-a128-8b40d2c563b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b6181c-c0bd-4e8a-aaa5-a8697922fb5d", "tag": "3b261692-ea26-4a17-8070-fd2a4a1139f8"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:54:49.302392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:54:49.302392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:54:49.310406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-81b73cc5-e4c4-47d1-b9be-805a9f64d461 req-b965e301-3d5d-4f85-a128-8b40d2c563b3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:49.310851 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-81b73cc5-e4c4-47d1-b9be-805a9f64d461 req-b965e301-3d5d-4f85-a128-8b40d2c563b3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:49.324270 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-81b73cc5-e4c4-47d1-b9be-805a9f64d461 req-b965e301-3d5d-4f85-a128-8b40d2c563b3 service nova] Creating event network-changed:3b261692-ea26-4a17-8070-fd2a4a1139f8 for instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d on hv-cinder-82694 Jan 29 03:54:49.335348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-81b73cc5-e4c4-47d1-b9be-805a9f64d461 req-b965e301-3d5d-4f85-a128-8b40d2c563b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038611 Jan 29 03:54:49.335942 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 510/1022] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:54:49.742863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:49.743471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:49.749601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:49.750046 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:49.751460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:49.751912 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:49.891129 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:49.898996 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6f98ba43-50cc-4aa4-8129-9328e5cc63d1 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.159979 Jan 29 03:54:49.899560 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 513/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:49 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:50.916892 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:50.917823 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:50.925066 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:50.925511 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:50.926328 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:50.926768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:51.067813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:51.075017 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a5be4a45-04b9-42c6-9cd7-117af1fa0c4d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.162656 Jan 29 03:54:51.075567 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 511/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:50 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:52.091710 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:52.092346 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:52.102427 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:52.102877 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:52.103692 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:52.104127 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:52.236569 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:52.243863 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fc13fa93-e2b7-447a-8ef4-3204da2b3c8c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.155829 Jan 29 03:54:52.244410 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 514/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:52 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:53.260419 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:53.261075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:53.268404 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:53.274091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:53.274091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:53.274091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:53.415274 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:53.422427 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ff0e270a-0864-434b-bffa-6645cd23c998 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.165673 Jan 29 03:54:53.422984 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 512/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:53 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:54.438491 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:54.439112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:54.445519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:54.445954 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:54.446743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:54.447170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:54.581610 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:54.588822 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-4b40c3a6-a973-4ffc-b8b2-79faeb80c08c tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.153878 Jan 29 03:54:54.589441 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 515/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:54 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:55.605804 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:55.606508 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:55.613345 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:55.613789 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:55.614589 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:55.615028 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:55.744412 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:55.751806 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-250a77dd-ed01-4a39-834d-16e34cef9717 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.149730 Jan 29 03:54:55.752356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 513/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:55 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:56.768711 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:56.769319 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:56.775577 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:56.776027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:56.776799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:56.777234 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:56.908416 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:56.915808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-776ff929-0f9c-416a-8511-9263fab7521f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.150844 Jan 29 03:54:56.916399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 516/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:56 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:57.932502 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:57.933098 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:57.939705 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:57.940153 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:57.940979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:57.941418 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:58.073112 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:58.080748 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-18fad228-b9a7-47d0-8dc1-0d03ba0c7564 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.151847 Jan 29 03:54:58.092725 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:57 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:54:59.097563 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:54:59.098187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:54:59.104434 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:59.104887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:59.105721 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:54:59.106171 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:54:59.241107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:54:59.248393 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c2bd9e59-5566-4fa3-9d92-548df68a2a75 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.154535 Jan 29 03:54:59.248947 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 517/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:54:59 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:55:00.128485 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-366b004e-518e-4b13-8328-cb5bf37ce71e req-279b662a-46c7-4493-af19-3173fca956e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b6181c-c0bd-4e8a-aaa5-a8697922fb5d", "name": "network-vif-plugged", "status": "completed", "tag": "3b261692-ea26-4a17-8070-fd2a4a1139f8"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:55:00.133817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:55:00.133817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:55:00.137279 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-366b004e-518e-4b13-8328-cb5bf37ce71e req-279b662a-46c7-4493-af19-3173fca956e1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:00.137724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-366b004e-518e-4b13-8328-cb5bf37ce71e req-279b662a-46c7-4493-af19-3173fca956e1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:00.150523 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-366b004e-518e-4b13-8328-cb5bf37ce71e req-279b662a-46c7-4493-af19-3173fca956e1 service nova] Creating event network-vif-plugged:3b261692-ea26-4a17-8070-fd2a4a1139f8 for instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d on hv-cinder-82694 Jan 29 03:55:00.155512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-366b004e-518e-4b13-8328-cb5bf37ce71e req-279b662a-46c7-4493-af19-3173fca956e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 Jan 29 03:55:00.156069 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 515/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:55:00.264786 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:55:00.265392 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:55:00.271668 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:00.272112 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:00.272884 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:00.273315 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:00.406471 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:55:00.414295 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-494cd44c-124e-45bf-8eac-ad3532a652a3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.153368 Jan 29 03:55:00.414852 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 518/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:55:00 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:55:01.431783 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:55:01.432506 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:55:01.439209 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:01.439654 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:01.440424 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:01.440856 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:01.574189 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:55:01.581496 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bbff3b04-3af7-481a-af7b-1b798dedaa41 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1266 microversion: 2.1 time: 0.154130 Jan 29 03:55:01.582051 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 516/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:55:01 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:55:02.597682 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:55:02.598262 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:55:02.604447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:02.605056 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:02.605697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:02.606122 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:02.740841 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:55:02.748233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-497e190d-acba-471d-b5b8-ee8f9d264901 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1452 microversion: 2.1 time: 0.154324 Jan 29 03:55:02.748789 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 519/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:55:02 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:55:02.764815 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:55:02.765416 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:55:02.771665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:02.772107 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:02.772869 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:02.773301 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:02.907387 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:55:02.914688 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-acf4b5cb-ab53-472e-9b29-c5612ab91fd0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1452 microversion: 2.1 time: 0.153732 Jan 29 03:55:02.915255 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 517/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:55:02 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:55:04.852293 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-cdb1ad60-9cbe-46f3-884f-03ad852df0d5 req-b9d263d3-0ed2-4212-9fae-e15bc418e108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b6181c-c0bd-4e8a-aaa5-a8697922fb5d", "tag": "3b261692-ea26-4a17-8070-fd2a4a1139f8"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:55:04.854082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:55:04.854082 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:55:04.862335 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-cdb1ad60-9cbe-46f3-884f-03ad852df0d5 req-b9d263d3-0ed2-4212-9fae-e15bc418e108 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:55:04.862849 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-cdb1ad60-9cbe-46f3-884f-03ad852df0d5 req-b9d263d3-0ed2-4212-9fae-e15bc418e108 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:55:04.873610 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-cdb1ad60-9cbe-46f3-884f-03ad852df0d5 req-b9d263d3-0ed2-4212-9fae-e15bc418e108 service nova] Creating event network-changed:3b261692-ea26-4a17-8070-fd2a4a1139f8 for instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d on hv-cinder-82694 Jan 29 03:55:04.878690 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-cdb1ad60-9cbe-46f3-884f-03ad852df0d5 req-b9d263d3-0ed2-4212-9fae-e15bc418e108 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029964 Jan 29 03:55:04.879359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 520/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:56:43.899808 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:56:43.900516 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 03:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:56:58.905487 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:56:58.906085 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:56:58.911742 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:56:58.912182 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:56:58.912974 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:56:58.913408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:56:58.938319 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Going to try to terminate instance {{(pid=123254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 03:56:59.247676 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4c8171f7-6518-4294-b362-3980cb09ceec tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 204 len: 0 microversion: 2.1 time: 0.347051 Jan 29 03:56:59.248273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 518/1038] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 03:56:58 2022] DELETE /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 29 03:56:59.254601 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07e6dc92-76eb-413a-81af-d79293fefc6b] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 29 03:56:59.261799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:56:59.261799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:56:59.266645 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:56:59.267096 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:56:59.267873 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:56:59.268313 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:56:59.404730 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:56:59.412027 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-175e02ae-f751-43f3-a8c9-dd429097a04f tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1577 microversion: 2.1 time: 0.159344 Jan 29 03:56:59.412570 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 521/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:56:59 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:00.429023 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:00.429729 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:00.436768 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:00.437221 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:00.437992 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:00.438455 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:00.583061 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:00.590298 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-91c1afcd-31a7-4424-b5b4-a01893042b7b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1577 microversion: 2.1 time: 0.165250 Jan 29 03:57:00.590848 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 519/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:00 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:01.607580 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:01.610361 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:01.616763 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:01.617113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:01.617904 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:01.618371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:01.651051 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] [07e6dc92-76eb-413a-81af-d79293fefc6b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42884. Jan 29 03:57:01.686172 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:01.693729 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-6acc3f5f-c8be-499f-9f1f-7d110666d953 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1509 microversion: 2.1 time: 0.089849 Jan 29 03:57:01.694412 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 522/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:01 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1509 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:02.013134 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-c33eaa83-a7e9-42af-a0b7-a80dc2df98e1 req-beec4c9b-0abe-4604-b082-aa9640d80430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b6181c-c0bd-4e8a-aaa5-a8697922fb5d", "name": "network-vif-deleted", "tag": "3b261692-ea26-4a17-8070-fd2a4a1139f8"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:57:02.015623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:57:02.015623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:57:02.023314 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-c33eaa83-a7e9-42af-a0b7-a80dc2df98e1 req-beec4c9b-0abe-4604-b082-aa9640d80430 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:02.023831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-c33eaa83-a7e9-42af-a0b7-a80dc2df98e1 req-beec4c9b-0abe-4604-b082-aa9640d80430 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:02.036408 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-c33eaa83-a7e9-42af-a0b7-a80dc2df98e1 req-beec4c9b-0abe-4604-b082-aa9640d80430 service nova] Creating event network-vif-deleted:3b261692-ea26-4a17-8070-fd2a4a1139f8 for instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d on hv-cinder-82694 Jan 29 03:57:02.042572 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-c33eaa83-a7e9-42af-a0b7-a80dc2df98e1 req-beec4c9b-0abe-4604-b082-aa9640d80430 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148432 Jan 29 03:57:02.043577 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 520/1042] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:57:02.710098 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:02.710743 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:02.717985 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:02.718385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:02.719173 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:02.719833 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:02.751621 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:02.752069 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:02.752519 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.objects.instance [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lazy-loading 'fault' on Instance uuid 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d {{(pid=123253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 29 03:57:02.793019 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:02.800470 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-04eda4a1-f2c4-4818-9e09-750e40596bf4 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 200 len: 1230 microversion: 2.1 time: 0.094197 Jan 29 03:57:02.801037 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 523/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:02 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:03.817679 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:03.822273 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:03.824923 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:03.825369 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:03.826156 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:03.826587 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:03.839343 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] HTTP exception thrown: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. Jan 29 03:57:03.839915 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Returning 404 to user: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 03:57:03.840714 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8d1de99c-c43e-4611-9740-a9f4fb8d026d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027138 Jan 29 03:57:03.841716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 521/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:03 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 03:57:03.886976 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2099994939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-924064062", "security_groups": [{"name": "tempest-secgroup-smoke-1196771207"}], "block_device_mapping_v2": [{"uuid": "8247dc62-0b18-416a-be28-7b9c7a919ebc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccb34270-5897-4f8c-bf79-a40c6714fbbe"}]}} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:57:03.993655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.network.neutron [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] validate_networks() for [('ccb34270-5897-4f8c-bf79-a40c6714fbbe', None, None, None, None, None)] {{(pid=123253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:57:04.423088 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:57:04.423506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image limits 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:57:04.423971 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:57:04.424371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image pref 0:0:0 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:57:04.424773 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.virt.hardware [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:57:04.433177 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:04.433618 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:04.434522 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:04.435474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:04.451792 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:57:04.455806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.quota [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for user 0639cda3fd4e406290324e3c61529bd6 and project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:57:04.509327 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Going to run 1 instances... {{(pid=123253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:57:04.511741 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8247dc62-0b18-416a-be28-7b9c7a919ebc',volume_size=None,volume_type=None)] {{(pid=123253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:57:04.879187 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-d1e4e038-8ddd-4fe1-a2a5-f8854734b000 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.996134 Jan 29 03:57:04.879814 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 524/1045] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:57:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:57:04.890065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-94d99f81-3e53-48ef-9473-9dfa0cafcc0a tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:04.890916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-94d99f81-3e53-48ef-9473-9dfa0cafcc0a tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:04.947987 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-94d99f81-3e53-48ef-9473-9dfa0cafcc0a tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:04.954694 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-94d99f81-3e53-48ef-9473-9dfa0cafcc0a tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1094 microversion: 2.1 time: 0.068602 Jan 29 03:57:04.955262 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 522/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:04 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:05.971797 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:05.972506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:05.978369 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:05.978818 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:05.979589 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:05.980022 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:06.040399 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:06.047882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-362e5837-847f-4eaf-8a38-5da94fbf6923 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1144 microversion: 2.1 time: 0.080312 Jan 29 03:57:06.048442 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 525/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:05 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:07.064438 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:07.065044 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:07.071977 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:07.072422 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:07.073333 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:07.073757 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:07.139183 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:07.147307 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-1b045fa6-443f-4451-b08c-3004b596bbb2 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1210 microversion: 2.1 time: 0.086556 Jan 29 03:57:07.147866 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 523/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:07 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:08.164787 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:08.165387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:08.171716 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:08.172107 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:08.172878 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:08.173305 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:08.323647 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:08.331715 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b48d807f-83c1-437f-8d4c-80994ad90f85 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1278 microversion: 2.1 time: 0.170520 Jan 29 03:57:08.332287 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 526/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:08 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:08.510538 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-df46a8f3-91cf-468b-b44f-693325436f6e req-ef335f5d-c2d3-4a48-94d2-43ddac1ff5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76926f43-8dae-4b00-abb2-2090c831180f", "tag": "70be74ee-ddc8-4279-8955-d293822d325c"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:57:08.513158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:57:08.513158 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:57:08.521168 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-df46a8f3-91cf-468b-b44f-693325436f6e req-ef335f5d-c2d3-4a48-94d2-43ddac1ff5ee service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:08.521629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-df46a8f3-91cf-468b-b44f-693325436f6e req-ef335f5d-c2d3-4a48-94d2-43ddac1ff5ee service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:08.534381 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-df46a8f3-91cf-468b-b44f-693325436f6e req-ef335f5d-c2d3-4a48-94d2-43ddac1ff5ee service nova] Creating event network-changed:70be74ee-ddc8-4279-8955-d293822d325c for instance 76926f43-8dae-4b00-abb2-2090c831180f on hv-cinder-82694 Jan 29 03:57:08.539324 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-df46a8f3-91cf-468b-b44f-693325436f6e req-ef335f5d-c2d3-4a48-94d2-43ddac1ff5ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032803 Jan 29 03:57:08.540280 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 524/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:57:09.348889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:09.349474 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:09.355868 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:09.356318 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:09.357121 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:09.357558 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:09.502330 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:09.509495 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fc248881-6a0e-474f-a39f-b0f31814ef76 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.164252 Jan 29 03:57:09.510047 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 527/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:09 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:10.528065 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:10.528706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:10.535224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:10.535667 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:10.536427 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:10.536855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:10.681163 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:10.688322 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-5affd34d-66bb-4819-8f2b-4558126a70e7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.164792 Jan 29 03:57:10.688870 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 525/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:10 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:11.704746 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:11.705371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:11.711540 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:11.711982 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:11.712738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:11.713166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:11.842699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:11.850646 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-21ef3be0-fc34-4b6c-b8ba-a468f99b6d62 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.149471 Jan 29 03:57:11.851220 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 528/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:11 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:12.867074 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:12.867727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:12.874070 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:12.874541 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:12.875941 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:12.876417 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:13.034234 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:13.041510 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-485f57a5-afc0-4476-b61c-2af42c4814d3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.177954 Jan 29 03:57:13.042066 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 526/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:12 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:14.057738 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:14.058375 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:14.065189 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:14.065639 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:14.066438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:14.066882 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:14.200428 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:14.208358 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-ee01d971-486f-42d0-a206-21e26390f393 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.154236 Jan 29 03:57:14.208852 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 529/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:14 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:15.225180 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:15.225813 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:15.232040 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:15.232481 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:15.233249 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:15.233679 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:15.366444 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:15.373770 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-0c2df1c8-65b0-4230-90d8-89ba6e731161 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.152234 Jan 29 03:57:15.374346 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 527/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:15 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:16.390506 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:16.391101 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:16.397241 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:16.397681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:16.398463 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:16.398887 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:16.528233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:16.536308 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-afd0d216-4618-4431-9983-449be9fde1d0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.149432 Jan 29 03:57:16.536867 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 530/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:16 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:17.552634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:17.553175 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:17.559406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:17.559853 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:17.560623 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:17.561071 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:17.691118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:17.698263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4243d048-1371-40f5-89f2-444991a69ae8 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.149404 Jan 29 03:57:17.698814 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 528/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:17 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:18.714970 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:18.715604 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:18.722232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:18.722678 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:18.723447 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:18.723873 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:18.808097 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-452b3870-0fc5-40a0-9e46-57c96875a96a req-a5b004d5-dbf2-4b91-81e4-a6f338c04ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76926f43-8dae-4b00-abb2-2090c831180f", "name": "network-vif-plugged", "status": "completed", "tag": "70be74ee-ddc8-4279-8955-d293822d325c"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:57:18.809609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:57:18.809609 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:57:18.819225 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-452b3870-0fc5-40a0-9e46-57c96875a96a req-a5b004d5-dbf2-4b91-81e4-a6f338c04ef1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:18.819763 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-452b3870-0fc5-40a0-9e46-57c96875a96a req-a5b004d5-dbf2-4b91-81e4-a6f338c04ef1 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:18.832102 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-452b3870-0fc5-40a0-9e46-57c96875a96a req-a5b004d5-dbf2-4b91-81e4-a6f338c04ef1 service nova] Creating event network-vif-plugged:70be74ee-ddc8-4279-8955-d293822d325c for instance 76926f43-8dae-4b00-abb2-2090c831180f on hv-cinder-82694 Jan 29 03:57:18.837124 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-452b3870-0fc5-40a0-9e46-57c96875a96a req-a5b004d5-dbf2-4b91-81e4-a6f338c04ef1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089156 Jan 29 03:57:18.837877 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 529/1059] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:57:18.864731 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:18.872113 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-691ecdfa-5e4e-4c27-987a-50815a64d415 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.160987 Jan 29 03:57:18.872681 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 531/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:18 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:19.890854 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:19.891465 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:19.897448 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:19.897891 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:19.898697 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:19.899131 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:20.061662 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:20.068920 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a217133f-c7de-41ca-9738-ad139c48d14e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1266 microversion: 2.1 time: 0.183611 Jan 29 03:57:20.069486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 530/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:19 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:21.086371 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:21.086977 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:21.093198 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:21.093643 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:21.094438 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:21.094870 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:21.232387 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:21.239805 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-0b0c7142-38e4-4375-82a4-ebe0b0ccff38 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1452 microversion: 2.1 time: 0.157125 Jan 29 03:57:21.240366 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 532/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:21 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:57:21.255871 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:57:21.256480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:57:21.263090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:21.263534 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:21.264302 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:21.264733 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:21.393869 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:57:21.401034 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-60916e67-643e-4b7b-9ff4-5cf223cf1278 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1452 microversion: 2.1 time: 0.148787 Jan 29 03:57:21.401581 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 531/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:57:21 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 29 03:57:23.534769 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-2bbfa1c5-41cc-4a85-b49b-9b3c3e07bfd9 req-edbee006-dea2-4d31-a13e-c39b0657de88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76926f43-8dae-4b00-abb2-2090c831180f", "tag": "70be74ee-ddc8-4279-8955-d293822d325c"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:57:23.536425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:57:23.536425 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:57:23.544134 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-2bbfa1c5-41cc-4a85-b49b-9b3c3e07bfd9 req-edbee006-dea2-4d31-a13e-c39b0657de88 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:57:23.544571 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-2bbfa1c5-41cc-4a85-b49b-9b3c3e07bfd9 req-edbee006-dea2-4d31-a13e-c39b0657de88 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:57:23.557013 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-2bbfa1c5-41cc-4a85-b49b-9b3c3e07bfd9 req-edbee006-dea2-4d31-a13e-c39b0657de88 service nova] Creating event network-changed:70be74ee-ddc8-4279-8955-d293822d325c for instance 76926f43-8dae-4b00-abb2-2090c831180f on hv-cinder-82694 Jan 29 03:57:23.562414 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-2bbfa1c5-41cc-4a85-b49b-9b3c3e07bfd9 req-edbee006-dea2-4d31-a13e-c39b0657de88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031145 Jan 29 03:57:23.563108 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 533/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:57:41.465781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:57:41.466395 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 03:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:59:03.021392 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-407843960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-924064062", "security_groups": [{"name": "tempest-secgroup-smoke-1196771207"}], "block_device_mapping_v2": [{"uuid": "902eaa36-fdcc-436b-80a8-cb106fa9896d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccb34270-5897-4f8c-bf79-a40c6714fbbe"}]}} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:59:03.130526 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.network.neutron [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] validate_networks() for [('ccb34270-5897-4f8c-bf79-a40c6714fbbe', None, None, None, None, None)] {{(pid=123254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 29 03:59:03.540307 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 29 03:59:03.540729 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image limits 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 29 03:59:03.541201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Flavor pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 29 03:59:03.541605 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Image pref 0:0:0 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 29 03:59:03.542014 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.virt.hardware [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 29 03:59:03.550490 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:03.550952 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:03.552326 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:03.552765 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:03.568453 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 29 03:59:03.572263 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.quota [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Getting quotas for user 0639cda3fd4e406290324e3c61529bd6 and project a12ca58f304343008cbef6b9b2f59dc6. Resources: {'ram', 'instances', 'cores'} {{(pid=123254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 29 03:59:03.624685 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Going to run 1 instances... {{(pid=123254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 29 03:59:03.626806 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='902eaa36-fdcc-436b-80a8-cb106fa9896d',volume_size=None,volume_type=None)] {{(pid=123254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 29 03:59:04.077840 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-de69c76d-c4fe-49cb-b813-af6e9d259918 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.061062 Jan 29 03:59:04.078677 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 532/1065] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jan 29 03:59:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 29 03:59:04.087460 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07e6dc92-76eb-413a-81af-d79293fefc6b] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 29 03:59:04.091840 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-169f3076-457f-4c07-b932-4d8286bc659d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:04.092525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-169f3076-457f-4c07-b932-4d8286bc659d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:04.151276 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-169f3076-457f-4c07-b932-4d8286bc659d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:04.157736 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-169f3076-457f-4c07-b932-4d8286bc659d tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1093 microversion: 2.1 time: 0.072376 Jan 29 03:59:04.158406 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 534/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:04 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:05.174315 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:05.174916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:05.182403 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:05.182850 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:05.183646 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:05.184080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:05.243927 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:05.251279 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b2de375c-d0e1-4eab-9dd8-105d5b198267 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1135 microversion: 2.1 time: 0.080667 Jan 29 03:59:05.251862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 533/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:05 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1135 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:06.268595 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:06.269128 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:06.277812 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:06.278279 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:06.279062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:06.279493 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:06.295215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] [07e6dc92-76eb-413a-81af-d79293fefc6b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43066. Jan 29 03:59:06.341241 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:06.348740 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-03f39d5d-69c6-416e-ae7b-91a5fb479fb9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1209 microversion: 2.1 time: 0.083855 Jan 29 03:59:06.349304 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 535/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:06 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:07.365480 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:07.366082 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:07.372852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:07.373558 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:07.374091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:07.374664 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:07.553591 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:07.561155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-ed4dcfab-7ae1-4c81-a16d-86fb93e1e02e tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.200122 Jan 29 03:59:07.561724 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 534/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:07 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:07.604028 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [req-0fe5dc1a-77b0-4e19-a0df-8326635552a0 req-c1e3ce3e-297c-4984-bbcf-0b61ea9d4f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b35e6d-1b70-4af1-916e-64421c1b4602", "tag": "a5c88619-1074-4a9e-823a-6d76bf007f3f"}]} {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:59:07.605659 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:59:07.605659 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: warnings.warn(msg) Jan 29 03:59:07.613186 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-0fe5dc1a-77b0-4e19-a0df-8326635552a0 req-c1e3ce3e-297c-4984-bbcf-0b61ea9d4f2d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:07.613697 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [req-0fe5dc1a-77b0-4e19-a0df-8326635552a0 req-c1e3ce3e-297c-4984-bbcf-0b61ea9d4f2d service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:07.625883 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.compute.server_external_events [req-0fe5dc1a-77b0-4e19-a0df-8326635552a0 req-c1e3ce3e-297c-4984-bbcf-0b61ea9d4f2d service nova] Creating event network-changed:a5c88619-1074-4a9e-823a-6d76bf007f3f for instance c6b35e6d-1b70-4af1-916e-64421c1b4602 on hv-cinder-82694 Jan 29 03:59:07.631385 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [req-0fe5dc1a-77b0-4e19-a0df-8326635552a0 req-c1e3ce3e-297c-4984-bbcf-0b61ea9d4f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031717 Jan 29 03:59:07.632062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 536/1070] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 03:59:08.577614 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:08.578258 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:08.584508 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:08.584958 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:08.585731 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:08.586201 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:08.719434 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:08.727155 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-b415af9b-f2e3-474c-a7a2-406855e15ee0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.153245 Jan 29 03:59:08.727708 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 535/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:08 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:09.744966 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:09.745676 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:09.751695 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:09.752132 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:09.752889 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:09.753317 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:09.885190 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:09.892299 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e9638a73-8345-439a-b926-007b91890d61 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.151726 Jan 29 03:59:09.892853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 537/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:09 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:10.908812 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:10.909407 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:10.915360 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:10.915817 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:10.916598 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:10.917043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:11.047932 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:11.055170 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-4df65272-3d46-4176-9849-21c96a8bbb43 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.150042 Jan 29 03:59:11.055734 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 536/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:10 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:12.072477 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:12.073081 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:12.079317 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:12.079776 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:12.080552 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:12.080988 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:12.213624 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:12.220894 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cf9ce8d2-9aff-4fa1-b9d3-98d6fdedaf40 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.152146 Jan 29 03:59:12.221453 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 538/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:12 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:13.237882 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:13.238521 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:13.244713 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:13.245160 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:13.245937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:13.246406 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:13.381530 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:13.388937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-bca00b43-b9f3-43e5-8f40-2d45d67a36e0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.154705 Jan 29 03:59:13.389488 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 537/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:13 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:14.405734 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:14.406292 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:14.413062 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:14.413553 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:14.414359 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:14.414791 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:14.545232 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:14.552564 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-69b7d2d9-30bf-44e7-a09b-adc2b857d2e3 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.150547 Jan 29 03:59:14.555498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 539/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:14 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:15.569238 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:15.569885 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:15.576191 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:15.576644 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:15.577423 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:15.577864 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:15.712050 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:15.719767 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-9d628155-1de4-438e-812e-d4a788067d5b tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.154152 Jan 29 03:59:15.720348 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 538/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:15 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:16.739440 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:16.740053 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:16.746263 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:16.746706 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:16.747463 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:16.747890 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:16.883255 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:16.890669 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-c8aa1e50-ba54-46e9-bb5a-df948b8ff133 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.155572 Jan 29 03:59:16.891233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 540/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:16 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:17.356921 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-602d523e-247b-42e4-91ef-4c64f85ac12d req-dc89b120-d655-405f-a7b4-ae637606cbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b35e6d-1b70-4af1-916e-64421c1b4602", "name": "network-vif-plugged", "status": "completed", "tag": "a5c88619-1074-4a9e-823a-6d76bf007f3f"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:59:17.358560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:59:17.358560 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:59:17.366634 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-602d523e-247b-42e4-91ef-4c64f85ac12d req-dc89b120-d655-405f-a7b4-ae637606cbee service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:17.367075 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-602d523e-247b-42e4-91ef-4c64f85ac12d req-dc89b120-d655-405f-a7b4-ae637606cbee service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:17.378064 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-602d523e-247b-42e4-91ef-4c64f85ac12d req-dc89b120-d655-405f-a7b4-ae637606cbee service nova] Creating event network-vif-plugged:a5c88619-1074-4a9e-823a-6d76bf007f3f for instance c6b35e6d-1b70-4af1-916e-64421c1b4602 on hv-cinder-82694 Jan 29 03:59:17.384056 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-602d523e-247b-42e4-91ef-4c64f85ac12d req-dc89b120-d655-405f-a7b4-ae637606cbee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030625 Jan 29 03:59:17.384643 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 539/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:59:17.907008 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:17.907612 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:17.913813 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:17.914300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:17.915066 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:17.915500 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:18.053956 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:18.061222 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-01de1f3a-57a0-41c8-a650-505d65ec7ca0 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1265 microversion: 2.1 time: 0.157866 Jan 29 03:59:18.063666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 541/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:17 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:19.079398 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:19.080091 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:19.087687 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:19.088118 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:19.088886 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:19.089874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:19.232014 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:19.239365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-64bc1feb-92e6-4a63-a30d-3a897b7da021 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1451 microversion: 2.1 time: 0.164228 Jan 29 03:59:19.239911 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 540/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:19 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:19.255233 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 03:59:19.255831 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 03:59:19.262213 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:19.262655 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:19.263411 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:19.263841 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:19.395594 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 03:59:19.406778 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-b974f1f4-ddef-44aa-9ecf-c958d357a109 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1451 microversion: 2.1 time: 0.155065 Jan 29 03:59:19.407699 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 542/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 03:59:19 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 03:59:19.473830 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:59:19.474055 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 03:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 03:59:21.523979 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-b138fd17-8b96-4bb6-9daf-155a89d53c32 req-c75813b4-7066-4942-9167-7fe024c9f8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b35e6d-1b70-4af1-916e-64421c1b4602", "tag": "a5c88619-1074-4a9e-823a-6d76bf007f3f"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 03:59:21.525512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 03:59:21.525512 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 03:59:21.532222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b138fd17-8b96-4bb6-9daf-155a89d53c32 req-c75813b4-7066-4942-9167-7fe024c9f8a3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 03:59:21.532665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b138fd17-8b96-4bb6-9daf-155a89d53c32 req-c75813b4-7066-4942-9167-7fe024c9f8a3 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 03:59:21.543789 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-b138fd17-8b96-4bb6-9daf-155a89d53c32 req-c75813b4-7066-4942-9167-7fe024c9f8a3 service nova] Creating event network-changed:a5c88619-1074-4a9e-823a-6d76bf007f3f for instance c6b35e6d-1b70-4af1-916e-64421c1b4602 on hv-cinder-82694 Jan 29 03:59:21.548641 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-b138fd17-8b96-4bb6-9daf-155a89d53c32 req-c75813b4-7066-4942-9167-7fe024c9f8a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115589 Jan 29 03:59:21.549222 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 541/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 03:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 03:59:27.154090 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 03:59:27.154831 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 03:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:00:03.907581 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:00:03.908178 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 04:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:01:01.435348 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:01.435990 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:01.439001 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-b0e2882d-c658-43aa-8803-3ebc25754b93 req-d6e9e2e9-cbbb-4093-bf8d-625b1f235f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b35e6d-1b70-4af1-916e-64421c1b4602", "tag": "a5c88619-1074-4a9e-823a-6d76bf007f3f"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 04:01:01.440595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 04:01:01.440595 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 04:01:01.441666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:01.442109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:01.443498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:01.443874 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:01.448556 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b0e2882d-c658-43aa-8803-3ebc25754b93 req-d6e9e2e9-cbbb-4093-bf8d-625b1f235f14 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:01.449080 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-b0e2882d-c658-43aa-8803-3ebc25754b93 req-d6e9e2e9-cbbb-4093-bf8d-625b1f235f14 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:01.460592 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-b0e2882d-c658-43aa-8803-3ebc25754b93 req-d6e9e2e9-cbbb-4093-bf8d-625b1f235f14 service nova] Creating event network-changed:a5c88619-1074-4a9e-823a-6d76bf007f3f for instance c6b35e6d-1b70-4af1-916e-64421c1b4602 on hv-cinder-82694 Jan 29 04:01:01.465937 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-b0e2882d-c658-43aa-8803-3ebc25754b93 req-d6e9e2e9-cbbb-4093-bf8d-625b1f235f14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032302 Jan 29 04:01:01.466888 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 542/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 04:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 29 04:01:01.469850 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 04:01:01.705520 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-e57660a4-49cd-4b43-98f0-134dc0f85efa tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 204 len: 0 microversion: 2.1 time: 0.274322 Jan 29 04:01:01.709214 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 543/1085] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 04:01:01 2022] DELETE /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 29 04:01:01.715061 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:01.715909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:01.723264 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:01.723806 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:01.724852 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:01.725365 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:01.975898 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:01.985336 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-7d2990f0-9a73-4568-8cc5-c26988807817 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1574 microversion: 2.1 time: 0.274507 Jan 29 04:01:01.986245 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 543/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:01 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:03.004853 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:03.005550 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:03.012137 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:03.012582 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:03.013353 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:03.013800 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:03.194345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:03.201585 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-5a6a06d5-e107-4e30-b0db-f5de2e0afa52 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1457 microversion: 2.1 time: 0.200793 Jan 29 04:01:03.202166 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 544/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:02 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1457 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:03.983706 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-85a5de75-a004-4452-b96c-09ae2f111497 req-c4952e19-bff3-4ea4-ac3b-2f78f87d7201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b35e6d-1b70-4af1-916e-64421c1b4602", "name": "network-vif-deleted", "tag": "a5c88619-1074-4a9e-823a-6d76bf007f3f"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 04:01:03.985224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 04:01:03.985224 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 04:01:03.992716 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-85a5de75-a004-4452-b96c-09ae2f111497 req-c4952e19-bff3-4ea4-ac3b-2f78f87d7201 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:03.993762 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-85a5de75-a004-4452-b96c-09ae2f111497 req-c4952e19-bff3-4ea4-ac3b-2f78f87d7201 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:04.003666 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-85a5de75-a004-4452-b96c-09ae2f111497 req-c4952e19-bff3-4ea4-ac3b-2f78f87d7201 service nova] Creating event network-vif-deleted:a5c88619-1074-4a9e-823a-6d76bf007f3f for instance c6b35e6d-1b70-4af1-916e-64421c1b4602 on hv-cinder-82694 Jan 29 04:01:04.008782 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-85a5de75-a004-4452-b96c-09ae2f111497 req-c4952e19-bff3-4ea4-ac3b-2f78f87d7201 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028723 Jan 29 04:01:04.009356 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 544/1088] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 04:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 04:01:04.218781 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:04.219390 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:04.226106 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:04.226588 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:04.227367 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:04.227806 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:04.293831 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:04.302656 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-cf05b53a-c43a-463d-96fa-21363d7ee073 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 200 len: 1224 microversion: 2.1 time: 0.087339 Jan 29 04:01:04.303237 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 545/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:04 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:05.321593 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:05.322320 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: c6b35e6d-1b70-4af1-916e-64421c1b4602] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:05.329160 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:05.329620 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:05.330502 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:05.330943 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:05.343837 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] HTTP exception thrown: Instance c6b35e6d-1b70-4af1-916e-64421c1b4602 could not be found. Jan 29 04:01:05.344426 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Returning 404 to user: Instance c6b35e6d-1b70-4af1-916e-64421c1b4602 could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 04:01:05.345299 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-a635c2e1-79d5-415f-ae89-7ffa607a0f67 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602" status: 404 len: 111 microversion: 2.1 time: 0.027842 Jan 29 04:01:05.345821 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 545/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:05 2022] GET /compute/v2.1/servers/c6b35e6d-1b70-4af1-916e-64421c1b4602 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 04:01:08.697568 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:08.698116 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:08.700781 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-60ee6487-6355-4df4-bf55-4200021d3522 req-a913214c-5480-4856-991d-b22e58a8e712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76926f43-8dae-4b00-abb2-2090c831180f", "tag": "70be74ee-ddc8-4279-8955-d293822d325c"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 04:01:08.702909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 04:01:08.702909 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 04:01:08.704486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:08.704935 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:08.705722 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:08.706170 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:08.711874 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-60ee6487-6355-4df4-bf55-4200021d3522 req-a913214c-5480-4856-991d-b22e58a8e712 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:08.712388 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-60ee6487-6355-4df4-bf55-4200021d3522 req-a913214c-5480-4856-991d-b22e58a8e712 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:08.723727 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-60ee6487-6355-4df4-bf55-4200021d3522 req-a913214c-5480-4856-991d-b22e58a8e712 service nova] Creating event network-changed:70be74ee-ddc8-4279-8955-d293822d325c for instance 76926f43-8dae-4b00-abb2-2090c831180f on hv-cinder-82694 Jan 29 04:01:08.729916 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-60ee6487-6355-4df4-bf55-4200021d3522 req-a913214c-5480-4856-991d-b22e58a8e712 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033009 Jan 29 04:01:08.730542 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 546/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 04:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 04:01:08.732048 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Going to try to terminate instance {{(pid=123253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 29 04:01:08.996041 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-1c94a227-09bb-46c8-bbd5-36bd9f4608b5 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 204 len: 0 microversion: 2.1 time: 0.301916 Jan 29 04:01:08.996799 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 546/1092] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 04:01:08 2022] DELETE /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 29 04:01:09.005202 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:09.006715 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:09.012862 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:09.013668 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:09.014650 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:09.015437 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:09.233665 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.policy [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:09.242497 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-8c8faf60-9359-4f39-8793-f1e3eac06266 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1577 microversion: 2.1 time: 0.241212 Jan 29 04:01:09.243257 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 547/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:08 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:10.260349 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:10.261038 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:10.267227 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:10.267666 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:10.268426 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:10.268854 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:10.410391 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:10.417591 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-9ab723f8-eec7-42c0-aa92-b2c4cfd8bc35 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1458 microversion: 2.1 time: 0.161567 Jan 29 04:01:10.418167 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 547/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:10 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:11.182607 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [req-a34d4daf-7351-48a4-8dd3-785a90b2c46a req-c433a102-ea44-4eeb-9b45-0d1e2cfe8610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76926f43-8dae-4b00-abb2-2090c831180f", "name": "network-vif-deleted", "tag": "70be74ee-ddc8-4279-8955-d293822d325c"}]} {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 29 04:01:11.184166 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 29 04:01:11.184166 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: warnings.warn(msg) Jan 29 04:01:11.190819 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-a34d4daf-7351-48a4-8dd3-785a90b2c46a req-c433a102-ea44-4eeb-9b45-0d1e2cfe8610 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:11.197663 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [req-a34d4daf-7351-48a4-8dd3-785a90b2c46a req-c433a102-ea44-4eeb-9b45-0d1e2cfe8610 service nova] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:11.202744 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.compute.server_external_events [req-a34d4daf-7351-48a4-8dd3-785a90b2c46a req-c433a102-ea44-4eeb-9b45-0d1e2cfe8610 service nova] Creating event network-vif-deleted:70be74ee-ddc8-4279-8955-d293822d325c for instance 76926f43-8dae-4b00-abb2-2090c831180f on hv-cinder-82694 Jan 29 04:01:11.207736 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [req-a34d4daf-7351-48a4-8dd3-785a90b2c46a req-c433a102-ea44-4eeb-9b45-0d1e2cfe8610 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028827 Jan 29 04:01:11.208346 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 548/1095] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Jan 29 04:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 29 04:01:11.434457 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:11.435017 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:11.441202 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:11.441675 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:11.442456 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:11.443486 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:11.504345 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.policy [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0639cda3fd4e406290324e3c61529bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12ca58f304343008cbef6b9b2f59dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 29 04:01:11.513684 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-de0e61aa-fe39-45d8-b91a-64570d750bd7 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 200 len: 1225 microversion: 2.1 time: 0.082861 Jan 29 04:01:11.514704 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 548/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:11 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 29 04:01:12.530633 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:12.531325 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 76926f43-8dae-4b00-abb2-2090c831180f] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:12.538254 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:12.538701 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:12.539471 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:12.539906 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:12.553104 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] HTTP exception thrown: Instance 76926f43-8dae-4b00-abb2-2090c831180f could not be found. Jan 29 04:01:12.553680 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Returning 404 to user: Instance 76926f43-8dae-4b00-abb2-2090c831180f could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 04:01:12.554530 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-e48eb8e4-08ee-4e18-a2ed-6e5505492635 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f" status: 404 len: 111 microversion: 2.1 time: 0.027855 Jan 29 04:01:12.555039 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 549/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:12 2022] GET /compute/v2.1/servers/76926f43-8dae-4b00-abb2-2090c831180f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 04:01:13.023525 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:13.024036 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.compute.api [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:13.030300 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:13.034215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:13.034215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:13.034215 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG oslo_concurrency.lockutils [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:13.045679 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.wsgi [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] HTTP exception thrown: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. Jan 29 04:01:13.046303 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Returning 404 to user: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. {{(pid=123253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 04:01:13.047109 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-fc8d668a-a57a-42b2-ae4a-75c405696927 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027818 Jan 29 04:01:13.047634 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 549/1098] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jan 29 04:01:13 2022] DELETE /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 29 04:01:13.055437 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '>' {{(pid=123254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:13.056043 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.compute.api [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] [instance: 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d] Fetching instance by UUID {{(pid=123254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 29 04:01:13.061712 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:13.062185 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:13.062957 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 29 04:01:13.063391 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG oslo_concurrency.lockutils [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Lock "56d64fc2-fc63-462e-9bec-aa175bb73d4b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 29 04:01:13.076111 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.wsgi [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] HTTP exception thrown: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. Jan 29 04:01:13.076682 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: DEBUG nova.api.openstack.wsgi [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Returning 404 to user: Instance 09b6181c-c0bd-4e8a-aaa5-a8697922fb5d could not be found. {{(pid=123254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 29 04:01:13.077479 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO nova.api.openstack.requestlog [None req-05deca91-0a77-4a18-be78-fce5e5c38057 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d" status: 404 len: 111 microversion: 2.1 time: 0.025722 Jan 29 04:01:13.077981 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: [pid: 123254|app: 0|req: 550/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jan 29 04:01:13 2022] GET /compute/v2.1/servers/09b6181c-c0bd-4e8a-aaa5-a8697922fb5d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 29 04:01:14.514498 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: DEBUG nova.api.openstack.wsgi [None req-14e77bcb-32df-4f66-a4f5-6fcbf3ace2b9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] Calling method '.version_select at 0x7f450129a670>' {{(pid=123253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 29 04:01:14.597541 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO nova.api.openstack.requestlog [None req-14e77bcb-32df-4f66-a4f5-6fcbf3ace2b9 tempest-TestVolumeBootPattern-1229902060 tempest-TestVolumeBootPattern-1229902060-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-924064062" status: 202 len: 0 microversion: 2.1 time: 0.086773 Jan 29 04:01:14.598352 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: [pid: 123253|app: 0|req: 550/1100] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jan 29 04:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-924064062 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 29 04:02:39.483039 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:02:39.483651 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 04:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:02:47.164240 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:02:47.164855 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 04:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:04:21.477486 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:04:21.478179 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 04:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:05:59.492378 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:05:59.493231 dv-cinder-826949-1-iscsi devstack@n-api.service[123253]: Sat Jan 29 04:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:06:07.173998 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:06:07.174629 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 04:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 29 04:06:16.867552 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 29 04:06:16.868354 dv-cinder-826949-1-iscsi devstack@n-api.service[123254]: Sat Jan 29 04:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!